-- Logs begin at Fri 2022-07-01 15:53:11 UTC, end at Fri 2022-07-01 17:00:27 UTC. -- Jul 01 16:31:44.737454 dv-cinder-797608-41-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 01 16:31:44.746963 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 01 16:31:44.748919 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 1 16:31:44 2022] *** Jul 01 16:31:44.748919 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 01 16:31:44.748919 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 01 16:31:44.748919 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: nodename: dv-cinder-797608-41-iscsi Jul 01 16:31:44.748919 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: machine: x86_64 Jul 01 16:31:44.748919 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: clock source: unix Jul 01 16:31:44.748919 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: pcre jit disabled Jul 01 16:31:44.748919 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: detected number of CPU cores: 4 Jul 01 16:31:44.748919 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: current working directory: / Jul 01 16:31:44.748919 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: detected binary path: /usr/bin/uwsgi-core Jul 01 16:31:44.749709 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: your processes number limit is 47680 Jul 01 16:31:44.749709 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: your memory page size is 4096 bytes Jul 01 16:31:44.749709 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: detected max file descriptor number: 2048 Jul 01 16:31:44.749709 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: lock engine: pthread robust mutexes Jul 01 16:31:44.749709 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: thunder lock: enabled Jul 01 16:31:44.749709 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 01 16:31:44.749709 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 01 16:31:44.794641 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: Python main interpreter initialized at 0x55bff82e39c0 Jul 01 16:31:44.794641 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: python threads support enabled Jul 01 16:31:44.794641 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: your server socket listen backlog is limited to 100 connections Jul 01 16:31:44.794641 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: your mercy for graceful operations on workers is 90 seconds Jul 01 16:31:44.794983 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: mapped 403077 bytes (393 KB) for 2 cores Jul 01 16:31:44.795070 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: *** Operational MODE: preforking *** Jul 01 16:31:44.795311 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: *** uWSGI is running in multiple interpreter mode *** Jul 01 16:31:44.795311 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: spawned uWSGI master process (pid: 109825) Jul 01 16:31:44.795507 dv-cinder-797608-41-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 01 16:31:44.802524 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: spawned uWSGI worker 1 (pid: 109826, cores: 1) Jul 01 16:31:44.802524 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: spawned uWSGI worker 2 (pid: 109827, cores: 1) Jul 01 16:31:44.802524 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 01 16:31:45.456796 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 16:31:45.462663 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 16:31:46.601627 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 16:31:46.601627 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: from cryptography.utils import int_from_bytes Jul 01 16:31:46.602260 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 16:31:46.602260 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: from cryptography.utils import int_from_bytes Jul 01 16:31:46.609781 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 16:31:46.609781 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: from cryptography.utils import int_from_bytes Jul 01 16:31:46.610221 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 16:31:46.610221 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: from cryptography.utils import int_from_bytes Jul 01 16:31:49.113336 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 16:31:49.113965 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 16:31:49.114071 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 16:31:49.114384 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 16:31:49.114641 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 16:31:49.114735 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 16:31:49.115312 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 16:31:49.115392 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.115594 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 16:31:49.115689 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.115927 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.116026 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 16:31:49.116202 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 16:31:49.116317 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.116566 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.116666 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.116875 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.116959 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.117195 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.117287 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.117512 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.117601 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.117836 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.117928 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.118098 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.118194 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.118446 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.118535 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.118772 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-41-iscsi {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.118867 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.119093 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.119178 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.119351 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.119444 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.119667 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.119764 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.119992 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.120081 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-41-iscsi {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.120301 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.120392 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.120607 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.120698 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.120909 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.120992 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.121224 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.121400 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.121515 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.121845 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.121971 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.122148 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.122244 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.122481 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.122691 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.122802 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.123001 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.123109 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.123314 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.123427 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.123621 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.123715 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.123959 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.124062 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.124273 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.124373 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.124582 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.124674 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.124901 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.125019 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-41-iscsi {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.125212 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.125305 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.125534 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.125618 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.125843 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.125963 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.126239 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-41-iscsi {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.126337 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.126583 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.126676 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.126890 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.126995 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.127203 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.127302 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.127522 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.127609 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.127825 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.127912 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.128151 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.128245 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.128470 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.128557 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.128787 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.128881 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.129105 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.129205 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.129404 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.129497 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.129707 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.129810 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.130018 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.130315 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.130421 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.130709 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.131288 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.131393 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.131476 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.131612 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.131706 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.131799 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.131885 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.131974 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.132059 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.132207 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.132312 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.132511 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.132599 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.132763 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.132856 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.133076 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.133169 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.133394 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.133519 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.133714 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.133823 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.134021 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.134111 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.134276 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.134408 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.134552 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.134649 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.134874 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.134963 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.135196 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.135287 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.135504 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.135590 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.135805 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.135901 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.136108 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.136210 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.136416 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.136519 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.136722 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.136833 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.137027 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.137120 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.137330 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.137422 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.137633 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.137731 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.137956 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.138043 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.138265 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.138395 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.138599 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.138696 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.138908 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.139005 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.139230 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.139324 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.139534 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.139634 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.139853 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.139945 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.140162 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.140248 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.140467 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.140561 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.140770 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.140856 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.141075 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.141169 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.141394 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.141481 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.141716 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.141801 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.142017 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.142109 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.142267 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.142384 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.142593 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.142680 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.142894 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.142983 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.143211 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.143300 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.143517 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.143614 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.143810 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.143896 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.144110 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.144196 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.144408 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.144494 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.144709 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.144806 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.145012 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.145098 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.145314 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.145408 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.145615 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.145716 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.145916 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.146001 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.146748 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.146850 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.147145 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.147251 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.147465 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.147581 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.147760 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.147847 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.148066 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.148162 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.148372 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.148464 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.148675 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.148772 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.148979 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.149072 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.149282 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.149384 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.149586 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.149674 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.149906 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.150002 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.150209 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.150302 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.150542 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.150635 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.150860 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.151164 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.151257 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.151469 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.151563 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.151787 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.151880 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.152092 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.152185 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.152392 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.152486 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.152710 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.152811 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.153009 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.153108 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.153314 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.153400 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.153628 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.153739 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.153931 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.154019 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.154234 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.154318 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.154557 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.154659 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.154862 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.154947 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.155165 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.155255 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.155469 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.155570 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.155771 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.155858 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.156073 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.156167 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.156372 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.156466 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.156676 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.156768 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.156984 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.157082 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.157287 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.157380 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.157588 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.157674 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.157890 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.157982 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.158189 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.158283 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.158535 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.158624 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.158859 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.158960 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.159170 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.159257 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.159478 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.159564 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.159785 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.159889 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.160106 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:31:49.160192 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.160443 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.160537 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.160753 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.160851 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.161065 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.161152 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.161393 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.161481 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.161705 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.161816 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.162989 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.163099 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.163099 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.163309 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.163481 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.163563 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.163665 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.163746 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.163882 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.164002 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.164203 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.164304 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.164518 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.164634 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.164829 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.164926 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.165139 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.165242 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.165466 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.165558 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.165786 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.165900 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.166106 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.166205 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.166437 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.166527 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.166758 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.166855 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.167074 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.167173 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.167391 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.167479 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.167718 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.167805 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.168038 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.168125 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.168348 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.168442 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.168660 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.168754 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.168970 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.169065 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.169292 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.169389 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.169621 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.169721 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.169932 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.170018 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.170242 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.170335 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.170582 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.170688 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.170894 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.170980 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.171199 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.171293 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.171510 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.171613 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.171820 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.171907 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.172143 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.172236 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.172455 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.172551 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.172766 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.172852 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.173074 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.173160 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.173386 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.173484 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.173695 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.173781 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.174009 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.174109 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.174321 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.174429 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.174647 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.174749 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.174954 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.175044 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.175258 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.175349 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.175568 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.175657 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.175871 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.175959 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.176179 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.176267 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.176487 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.176573 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.176793 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.176878 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.177148 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.177256 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.177402 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.177545 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.177786 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.178214 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.178308 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.178405 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.178485 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.178576 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.178685 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.178781 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.179018 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.179106 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.179326 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.179413 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.179639 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.179735 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.179952 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.180040 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.180264 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.180357 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.180570 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.180670 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.180881 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.180974 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.181184 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.181270 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.181490 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.181576 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.181801 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.181886 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.182110 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.182204 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.182444 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.182535 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.182757 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.182861 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.183067 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.183155 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.183372 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.183459 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.183690 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.183775 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.184003 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.184161 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.184319 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.184405 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.184631 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.184719 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.184942 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.185036 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.185267 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.185353 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.185584 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.185671 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.185958 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.186138 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.186223 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.186303 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.186582 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.186672 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.186885 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.186988 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.187265 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.187366 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.187494 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.187591 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.187801 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.187889 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.188105 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.188193 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.188408 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.188495 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.188711 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.188806 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.189014 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.189101 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.189316 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.189410 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.189629 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.189716 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.189931 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.190018 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.190237 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.190324 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.190563 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.190651 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.190865 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.190952 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.191170 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.191265 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.191495 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.191591 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.191806 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.191892 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.192114 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.192214 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.192422 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.192510 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.192728 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.192815 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.193064 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.193174 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.193586 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.193739 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.193900 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.194044 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.194214 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.194444 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.194604 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.194749 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.194899 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.195110 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.195210 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.195452 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.195599 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.195773 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.196322 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.196434 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.196642 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.196881 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.196970 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.197253 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.197457 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.197567 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.197858 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.197960 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.198198 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.198507 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.198600 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.198855 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.199105 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.199196 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.199471 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.199670 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.199791 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.200095 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.200269 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.200425 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.200625 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.200781 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.200975 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.201142 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.201289 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.201486 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.201638 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.201896 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.202097 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.202197 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.202561 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.202653 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.202902 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.202990 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.203216 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.203317 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.203522 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.203608 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.203834 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.203928 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.204161 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.204261 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.204493 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.204584 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.204802 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.204903 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.205110 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.205207 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.205433 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.205519 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.205744 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.205830 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.206054 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.206371 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.206459 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.206679 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.206764 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.206985 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.207083 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.207295 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.207381 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.207612 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.207728 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.207921 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.208030 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.208230 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.208325 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.208535 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.208630 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.209448 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.209564 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.209778 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.209869 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.210116 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.210227 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.210467 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.210564 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.210779 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.210874 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.211102 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.211197 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.211414 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.211601 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.211737 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.211926 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.212056 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.212245 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.212343 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.212565 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.212652 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.212879 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.212972 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.213193 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.213295 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.213516 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.213603 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.213831 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.213917 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.214134 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.214222 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.214476 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.214565 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.214792 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.214879 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.215095 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.215187 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.215412 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.215501 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.215719 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.215805 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.216028 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.216122 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.216341 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.216427 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.216648 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.216734 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.216958 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.217046 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.217284 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.217369 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.217612 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.217837 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.217928 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.218009 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.218220 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.218308 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.218584 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.218685 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.219273 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.219273 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.219497 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.219759 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.219884 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.220087 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.220209 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.220403 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.220524 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.220707 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.220824 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.221017 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.221206 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.221327 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.221541 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.221858 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.221983 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.222185 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.222299 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.222538 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.222652 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.222855 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.222959 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.223173 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.223259 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.223491 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.223578 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.223805 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.223901 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.224131 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.224216 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.224522 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.225521 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.225626 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.225718 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.225718 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.225880 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.225967 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.226047 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.226201 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.226290 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.226539 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.226846 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.226941 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.227151 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.227253 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.227455 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.227561 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.227761 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.227897 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.228134 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.228341 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.228442 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.228652 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.228739 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.228959 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.229054 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.229267 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.229582 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.229668 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.229888 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.229974 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.230206 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.230293 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.230539 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.230629 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.230864 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.231144 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.231240 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.231463 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.231566 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.231767 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.231857 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.232069 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.232164 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.232413 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.232501 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.232742 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.232837 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.233059 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.233147 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.233377 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.233473 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.233691 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.233777 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.234006 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.234093 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.234316 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.234488 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.234701 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.234789 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.235011 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.235097 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.235320 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.235420 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.235628 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.235723 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.235934 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.236029 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.236242 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.236339 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.236545 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.236639 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.236859 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.236953 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.237167 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.237261 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.237476 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.237561 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.237785 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.237904 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.238090 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.238189 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.238420 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.238513 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.238727 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.238814 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.239033 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.239127 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.239341 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.239429 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.239646 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.239738 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.239993 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.240186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.240665 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.240755 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.240755 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.240887 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.240984 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.241061 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.241296 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.241383 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.241603 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.241703 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.241920 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.242007 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.242225 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.242312 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.242557 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.242660 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.242881 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.242981 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.243173 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.243260 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.243484 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.243648 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.243790 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.243878 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.244106 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.244204 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.244415 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.244503 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.244720 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.244851 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.245025 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.245120 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.245329 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.245416 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.245632 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.245718 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.245937 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.246025 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.246247 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.246336 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.246595 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.246683 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.246902 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.246988 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.247203 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.247291 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.247511 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.247601 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.247816 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.247991 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.248122 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.248218 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.248471 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.248578 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.248743 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.248840 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.249064 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.249159 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.249371 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.249459 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.249675 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.249773 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.249980 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.250067 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.250289 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.250395 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.250630 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.250734 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.250936 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.251030 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.251241 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.251329 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.251547 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.251635 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.251849 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.251935 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.252154 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.252242 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.252470 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.252558 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.252779 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.252872 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.253088 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.253187 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.253408 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.253503 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.253728 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.253820 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.254036 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.254123 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.254435 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.254528 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.254675 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.254762 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.254978 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.255079 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.255282 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.255369 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.255613 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.255708 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.256229 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.256333 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.256425 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.256506 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.256584 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.256695 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.256831 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.257020 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.257138 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.257332 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.257444 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.257645 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.257768 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.257968 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.258107 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.258291 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.258399 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.258642 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.258749 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.258948 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.259036 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.259258 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.259345 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.259569 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.259666 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.259877 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.259964 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.260189 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.260277 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.260496 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.260596 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.260804 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.260891 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.261113 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.261207 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.261422 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.261519 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.261732 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.261820 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.262040 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.262126 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.262376 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.262480 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.262676 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.262776 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.262986 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.263074 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.263291 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.263379 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.263595 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.263680 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.263919 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.264006 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.264234 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.264322 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.264547 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.264637 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.264863 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.264950 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.265172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.265274 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.265477 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.265564 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.265790 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.265908 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.266100 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.266218 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.266444 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.266547 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.266759 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.266856 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.267071 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.267158 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.267382 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.267468 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.267694 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.267789 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.268008 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.268096 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.268322 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.268420 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.268633 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.268731 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.268945 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.269044 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.269252 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.269346 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.269562 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.269663 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.269875 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.269971 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.270183 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.270277 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.270526 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.270627 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.270837 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.270923 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.271143 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.271750 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.272058 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.272425 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.272509 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.272589 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.272667 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.272746 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.272963 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.273062 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.273284 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.273484 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.273700 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.273787 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.274011 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.274106 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.274317 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.274420 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.274745 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.274850 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.275055 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.275183 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.275366 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.275454 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.275685 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.275780 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.275995 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.276081 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.276314 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.276402 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.276619 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.276720 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.276932 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.277020 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.277239 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.277335 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.277563 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.277659 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.277884 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.277970 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.278191 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.278278 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.278531 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.278631 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.278837 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.278932 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.279144 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.279238 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.279453 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.279542 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.279762 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.279855 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.280071 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.280180 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.280395 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.280491 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.280795 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.280883 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.281106 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.281193 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.281413 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.281508 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.281736 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.281823 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.282044 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.282133 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.282364 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.282469 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.282674 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.282764 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.282979 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.283066 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.283285 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.283455 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.283609 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.283698 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.283913 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.284000 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.284222 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.284322 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.284533 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.284620 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.284839 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.284927 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.285143 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.285282 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.285447 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.285543 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.285770 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.285866 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.286075 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.286172 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.286428 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.286520 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.286744 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.286879 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.287799 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.287911 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.287999 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.288179 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.288269 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.288520 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.288654 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.288837 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.288947 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.289164 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.289263 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.289482 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.289588 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.289786 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.289883 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.290093 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.290188 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.290432 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.290543 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.290746 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.290840 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.291057 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.291153 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.291386 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.291482 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.291692 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.291786 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.292004 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.292116 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.292319 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.292409 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.292632 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.292727 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.292942 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.293035 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.293255 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.293342 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.293558 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.293643 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.293860 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.293947 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.294169 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.294265 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.294496 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.294585 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.294804 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.294905 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.295110 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.295196 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.295419 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.295504 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.295723 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.295817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.296024 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.296111 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.296325 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.296412 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.296647 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.296742 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.296951 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.297036 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.297273 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.297360 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.297584 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.297679 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.297889 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.297982 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.298194 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.298288 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.298520 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.298635 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.298863 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.298970 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.299161 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.299248 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.299494 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.299582 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.299815 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.299901 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.300135 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.300220 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.300461 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.300548 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.300767 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.300851 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.301074 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.301168 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.301388 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.301476 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.301694 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.301780 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.302001 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.302099 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.302307 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.302426 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.302757 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.302846 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.303070 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.303166 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.303383 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.303469 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.303690 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.303775 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.304001 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.304095 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.304312 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.304397 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.304626 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.304712 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.304936 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.305167 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.305262 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.305497 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.305583 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.305813 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.305912 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.306129 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.306216 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.306464 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.306555 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.306782 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.306881 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.307094 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.307180 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.307407 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.307493 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.307718 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.307813 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.308032 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.308117 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.308341 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.308426 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.308666 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.308752 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.308987 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.309095 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.309302 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.309389 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.309620 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.309708 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.309936 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.310021 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.310253 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.310414 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.310592 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.310679 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.310902 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.310988 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.311222 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.311308 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.311542 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.311636 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.311850 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.311937 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.312167 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.312394 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.312484 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.312730 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.312824 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.313053 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.313148 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.313369 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.313457 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.313681 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.313768 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.313994 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.314094 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.314304 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.314424 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.314637 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.314725 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.314951 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.315046 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.315264 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.315350 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.315581 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.315674 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.315910 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.316005 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.316232 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.316319 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.316548 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.316635 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.316863 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.316951 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.317178 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.317265 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.317500 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.317690 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.317821 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.318005 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.318171 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.318421 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.318565 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.318861 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.318967 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.319176 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.319275 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.319491 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.319579 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.319810 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.319897 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.320128 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.320213 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.320441 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.320527 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.320754 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.321090 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.321322 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.321415 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.321631 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.321719 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.321937 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.322033 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.322248 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.322428 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.322584 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.322679 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.322891 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.322978 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.323212 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.323304 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.323523 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.323619 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.323857 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.324049 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.324177 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.324400 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.324486 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.324714 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.324803 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.325040 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.325305 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.325392 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.325629 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.325724 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.325960 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.326046 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.326284 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.326384 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.326618 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.326707 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.326924 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.327012 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.327240 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.327326 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.327551 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.327639 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.327856 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.327951 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.328159 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.328254 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.328468 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.328555 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.328777 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.328864 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.329083 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.329182 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.329391 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.329487 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.329692 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.329779 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.330000 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.330100 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.330315 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.330424 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.330641 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.330739 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.330947 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.331172 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.331260 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.331526 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.331621 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.331834 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.332111 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.332206 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.332424 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.332510 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.332733 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.332819 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.333035 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.333123 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.333342 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.333428 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.333645 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.334239 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.334642 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.334731 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.334958 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.335046 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.335284 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.335422 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.335596 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.335685 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.335906 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.336000 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.336222 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.336328 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.336530 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.336619 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.336843 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.336929 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.337153 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.337242 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.337467 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.337562 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.337778 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.337902 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.338084 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.338186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.338421 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.338525 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.338731 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.338819 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.339038 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.339277 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.339366 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.339615 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.339711 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.339935 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.340028 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.340240 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.340329 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.340546 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.340639 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.340856 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.340942 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.341159 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.341246 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.341460 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.341545 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.341763 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.341857 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.342072 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.342159 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.342398 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.342489 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.342710 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.342809 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.343018 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.343104 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.343329 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.343414 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.343637 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.343806 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.343946 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.344039 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.344254 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.344341 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.344562 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.344657 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.344869 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.344963 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.345174 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.345268 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.345481 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.345569 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.345788 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.345874 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.346099 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.346193 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.346464 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.346680 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.346769 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.347020 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.347105 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.347343 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.347438 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.347680 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.347767 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.347986 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.352497 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.352600 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.352685 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.352754 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.352820 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.352885 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.352950 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.353023 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.353090 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.353155 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.353222 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.353287 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.353359 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.353438 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.353505 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.353571 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.353636 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.353700 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.353779 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.353852 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.353919 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.353984 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.354049 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.354114 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.354186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.354253 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.354329 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.354329 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.354495 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.354562 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.354640 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.354721 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.354787 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.354852 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.354916 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.354994 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.355062 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.355127 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.355199 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.355271 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.355337 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.355409 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.355475 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.355547 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.355618 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.355618 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.355932 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.356019 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.356088 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.356223 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.356301 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.356540 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.356625 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.356849 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.356933 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.357151 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.357226 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.357454 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.357538 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.357761 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.357845 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.358063 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.358150 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.358382 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.358514 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.358692 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.358830 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.358998 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.359152 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.359307 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.359475 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.359610 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.359787 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.359912 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.360111 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.360206 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.360437 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.360526 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.360753 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.360905 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.361073 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.361170 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.361376 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.361469 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.361678 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.361766 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.361983 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.362078 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.362283 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.362385 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.362629 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.362718 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.362933 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.363029 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.363266 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.363398 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.363571 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.363657 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.363887 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.363974 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.364205 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.364290 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.364515 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.364609 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.364819 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.364906 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.365186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.365275 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.365560 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.365651 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.365871 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.365968 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.366321 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.366488 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.366488 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.366652 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.366808 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.366895 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.367118 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.367214 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.367425 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.367524 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.367731 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.367818 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.368036 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.368122 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.368341 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.368437 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.368647 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.368734 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.368952 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.369038 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.369262 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.369359 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.369567 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.369653 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.369871 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.369958 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.370175 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.370262 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.370512 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.370601 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.370824 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.370966 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.371141 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.371228 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.371472 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.371558 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.371785 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.371872 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.372098 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.372185 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.372408 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.372511 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.372713 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.372880 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.373022 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.373109 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.373336 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.373421 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.373653 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.373747 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.373972 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.374057 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.374282 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.374478 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.374618 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.374743 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.374947 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.375034 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.375260 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.375346 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.375576 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.375671 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.375892 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.375986 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.376204 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.376297 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.376518 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.376613 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.376845 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.376930 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.377156 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.377243 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.377462 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.377549 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.377704 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 16:31:49.377792 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.378096 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.378446 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.378770 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.379085 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.379420 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.379737 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.380051 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.380372 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.380710 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.381159 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.381495 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.381815 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.382149 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.382507 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.382826 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.383159 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.383490 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.383849 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.384167 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.384516 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.384849 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.385170 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.385485 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.385798 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:31:49.386045 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 16:31:49.534244 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO dbcounter [None req-047e4d23-3afc-4283-a1e2-e0dd659c5f35 None None] Registered counter for database nova_api Jul 01 16:31:49.541082 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO dbcounter [None req-543f3a02-8d7f-4a8e-b71a-98243d69e5de None None] Registered counter for database nova_api Jul 01 16:31:49.555033 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_db.sqlalchemy.engines [None req-047e4d23-3afc-4283-a1e2-e0dd659c5f35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 16:31:49.560678 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG oslo_db.sqlalchemy.engines [None req-543f3a02-8d7f-4a8e-b71a-98243d69e5de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 16:31:49.561602 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writer thread running {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 16:31:49.567063 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG dbcounter [-] [109826] Writer thread running {{(pid=109826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 16:31:49.618555 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.context [None req-047e4d23-3afc-4283-a1e2-e0dd659c5f35 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d4cbc3c-94ee-4f68-9082-34d85fef2b77(cell1) {{(pid=109827) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 16:31:49.622407 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-047e4d23-3afc-4283-a1e2-e0dd659c5f35 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:31:49.623978 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-047e4d23-3afc-4283-a1e2-e0dd659c5f35 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:31:49.624653 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.context [None req-543f3a02-8d7f-4a8e-b71a-98243d69e5de None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d4cbc3c-94ee-4f68-9082-34d85fef2b77(cell1) {{(pid=109826) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 16:31:49.624785 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-047e4d23-3afc-4283-a1e2-e0dd659c5f35 None None] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:31:49.626687 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-047e4d23-3afc-4283-a1e2-e0dd659c5f35 None None] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:31:49.628587 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG oslo_concurrency.lockutils [None req-543f3a02-8d7f-4a8e-b71a-98243d69e5de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:31:49.628682 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO dbcounter [None req-047e4d23-3afc-4283-a1e2-e0dd659c5f35 None None] Registered counter for database nova_cell0 Jul 01 16:31:49.630188 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG oslo_concurrency.lockutils [None req-543f3a02-8d7f-4a8e-b71a-98243d69e5de None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:31:49.631543 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG oslo_concurrency.lockutils [None req-543f3a02-8d7f-4a8e-b71a-98243d69e5de None None] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:31:49.633491 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG oslo_concurrency.lockutils [None req-543f3a02-8d7f-4a8e-b71a-98243d69e5de None None] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:31:49.634529 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO dbcounter [None req-047e4d23-3afc-4283-a1e2-e0dd659c5f35 None None] Registered counter for database nova_cell1 Jul 01 16:31:49.635759 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO dbcounter [None req-543f3a02-8d7f-4a8e-b71a-98243d69e5de None None] Registered counter for database nova_cell0 Jul 01 16:31:49.641401 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO dbcounter [None req-543f3a02-8d7f-4a8e-b71a-98243d69e5de None None] Registered counter for database nova_cell1 Jul 01 16:31:49.641819 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_db.sqlalchemy.engines [None req-047e4d23-3afc-4283-a1e2-e0dd659c5f35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 16:31:49.644037 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_db.sqlalchemy.engines [None req-047e4d23-3afc-4283-a1e2-e0dd659c5f35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 16:31:49.648793 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writer thread running {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 16:31:49.648960 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG oslo_db.sqlalchemy.engines [None req-543f3a02-8d7f-4a8e-b71a-98243d69e5de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 16:31:49.650904 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG oslo_db.sqlalchemy.engines [None req-543f3a02-8d7f-4a8e-b71a-98243d69e5de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 16:31:49.656004 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG dbcounter [-] [109826] Writer thread running {{(pid=109826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 16:31:49.659426 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG dbcounter [-] [109826] Writer thread running {{(pid=109826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 16:31:49.787488 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writer thread running {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 16:31:49.797317 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO dbcounter [None req-047e4d23-3afc-4283-a1e2-e0dd659c5f35 None None] Registered counter for database nova_cell0 Jul 01 16:31:49.806221 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO dbcounter [None req-543f3a02-8d7f-4a8e-b71a-98243d69e5de None None] Registered counter for database nova_cell0 Jul 01 16:31:49.806453 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_db.sqlalchemy.engines [None req-047e4d23-3afc-4283-a1e2-e0dd659c5f35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 16:31:49.810893 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writer thread running {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 16:31:49.816153 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG oslo_db.sqlalchemy.engines [None req-543f3a02-8d7f-4a8e-b71a-98243d69e5de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 16:31:49.821176 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG dbcounter [-] [109826] Writer thread running {{(pid=109826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 16:31:50.150135 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: WARNING keystonemiddleware.auth_token [None req-543f3a02-8d7f-4a8e-b71a-98243d69e5de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 16:31:50.152212 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: WARNING keystonemiddleware.auth_token [None req-047e4d23-3afc-4283-a1e2-e0dd659c5f35 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 16:31:50.157424 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: WARNING keystonemiddleware.auth_token [None req-543f3a02-8d7f-4a8e-b71a-98243d69e5de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 16:31:50.159435 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: WARNING keystonemiddleware.auth_token [None req-047e4d23-3afc-4283-a1e2-e0dd659c5f35 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 16:31:50.498790 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: WARNING keystonemiddleware.auth_token [None req-543f3a02-8d7f-4a8e-b71a-98243d69e5de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 16:31:50.500715 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: WARNING keystonemiddleware.auth_token [None req-047e4d23-3afc-4283-a1e2-e0dd659c5f35 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 16:31:50.504616 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: WARNING keystonemiddleware.auth_token [None req-543f3a02-8d7f-4a8e-b71a-98243d69e5de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 16:31:50.506703 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: WARNING keystonemiddleware.auth_token [None req-047e4d23-3afc-4283-a1e2-e0dd659c5f35 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 16:31:50.509976 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bff82e39c0 pid: 109826 (default app) Jul 01 16:31:50.511978 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bff82e39c0 pid: 109827 (default app) Jul 01 16:31:50.512110 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-543f3a02-8d7f-4a8e-b71a-98243d69e5de None None] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:31:50.513206 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-543f3a02-8d7f-4a8e-b71a-98243d69e5de None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001709 Jul 01 16:31:50.513615 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Fri Jul 1 16:31:50 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:33:07.148460 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-047e4d23-3afc-4283-a1e2-e0dd659c5f35 None None] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:33:07.149683 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-047e4d23-3afc-4283-a1e2-e0dd659c5f35 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001970 Jul 01 16:33:07.150112 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 1/2] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 1 16:33:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:33:07.162395 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG dbcounter [-] [109826] Writing DB stats nova_api:SELECT=3 {{(pid=109826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:33:07.163513 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG dbcounter [-] [109826] Writing DB stats nova_cell0:SELECT=3 {{(pid=109826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:33:07.164359 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG dbcounter [-] [109826] Writing DB stats nova_cell1:SELECT=3 {{(pid=109826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:33:07.165418 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG dbcounter [-] [109826] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:33:07.643077 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-3a304d50-285d-4075-b124-3a23f41d5061 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:33:07.675228 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-3a304d50-285d-4075-b124-3a23f41d5061 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.519017 Jul 01 16:33:07.676341 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 2/3] 10.222.0.57 () {60 vars in 1291 bytes} [Fri Jul 1 16:33:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:33:09.790672 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-047e4d23-3afc-4283-a1e2-e0dd659c5f35 None None] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:33:09.791661 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-047e4d23-3afc-4283-a1e2-e0dd659c5f35 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 01 16:33:09.792267 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 2/4] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 1 16:33:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:33:09.858838 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-969d6d4d-3769-4153-af75-f2a76b437665 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 256, "name": "cirros256", "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "c1"}} {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:33:09.879964 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:33:09.879964 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: warnings.warn(msg) Jul 01 16:33:09.909274 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-969d6d4d-3769-4153-af75-f2a76b437665 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.109964 Jul 01 16:33:09.910394 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 3/5] 10.222.0.57 () {64 vars in 1282 bytes} [Fri Jul 1 16:33:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 16:33:09.924664 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writing DB stats nova_api:SELECT=3 {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:33:09.926287 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writing DB stats nova_cell1:SELECT=3 {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:33:09.927702 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writing DB stats nova_cell0:SELECT=3 {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:33:09.928757 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:33:10.148225 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-666a9dc3-99fc-4b87-a811-1b1aca6969b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:33:10.150739 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:33:10.150739 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: warnings.warn(msg) Jul 01 16:33:10.211918 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-666a9dc3-99fc-4b87-a811-1b1aca6969b3 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.293396 Jul 01 16:33:10.220560 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 3/6] 10.222.0.57 () {64 vars in 1335 bytes} [Fri Jul 1 16:33:09 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:33:12.391458 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-969d6d4d-3769-4153-af75-f2a76b437665 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:33:12.392465 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-969d6d4d-3769-4153-af75-f2a76b437665 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002161 Jul 01 16:33:12.393010 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 4/7] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 1 16:33:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:33:12.501175 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-f28957b0-6abb-4e0a-87bc-57837a928c4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "name": "ds512M", "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d1", "ram": 512, "swap": 0}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:33:12.519957 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:33:12.519957 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: warnings.warn(msg) Jul 01 16:33:12.542320 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-f28957b0-6abb-4e0a-87bc-57837a928c4e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143604 Jul 01 16:33:12.542897 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 4/8] 10.222.0.57 () {64 vars in 1282 bytes} [Fri Jul 1 16:33:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 16:33:12.559175 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-f200a846-c888-4116-95fb-bb218175ad25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:33:12.560669 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:33:12.560669 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: warnings.warn(msg) Jul 01 16:33:12.594770 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-f200a846-c888-4116-95fb-bb218175ad25 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039478 Jul 01 16:33:12.595763 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 5/9] 10.222.0.57 () {64 vars in 1335 bytes} [Fri Jul 1 16:33:12 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:33:14.724848 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-f28957b0-6abb-4e0a-87bc-57837a928c4e admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:33:14.726623 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-f28957b0-6abb-4e0a-87bc-57837a928c4e admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001682 Jul 01 16:33:14.727485 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 5/10] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 1 16:33:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:33:14.788033 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-d6100c50-ab2b-4aba-911a-80614410c3ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "swap": 0, "rxtx_factor": 1.0, "name": "ds1G", "ram": 1024}} {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:33:14.806997 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-d6100c50-ab2b-4aba-911a-80614410c3ce admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073654 Jul 01 16:33:14.810442 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 6/11] 10.222.0.57 () {64 vars in 1282 bytes} [Fri Jul 1 16:33:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 16:33:14.820799 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-3ff779dd-c742-4faf-bc20-bcfe1e400a80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:33:14.852251 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-3ff779dd-c742-4faf-bc20-bcfe1e400a80 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035570 Jul 01 16:33:14.852822 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 6/12] 10.222.0.57 () {64 vars in 1335 bytes} [Fri Jul 1 16:33:14 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:33:16.986771 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-d6100c50-ab2b-4aba-911a-80614410c3ce admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:33:16.987787 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-d6100c50-ab2b-4aba-911a-80614410c3ce admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jul 01 16:33:16.988191 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 7/13] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 1 16:33:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:33:17.047526 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-f67668b6-2334-44a8-8058-24881004d9cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "swap": 0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:33:17.065279 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-f67668b6-2334-44a8-8058-24881004d9cf admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071228 Jul 01 16:33:17.065824 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 7/14] 10.222.0.57 () {64 vars in 1282 bytes} [Fri Jul 1 16:33:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 16:33:17.078143 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-4bdf1616-7f3a-4ce5-977d-057514c48b6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:33:17.100333 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-4bdf1616-7f3a-4ce5-977d-057514c48b6d admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025951 Jul 01 16:33:17.100891 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 8/15] 10.222.0.57 () {64 vars in 1335 bytes} [Fri Jul 1 16:33:17 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:33:19.222426 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-f67668b6-2334-44a8-8058-24881004d9cf admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:33:19.223420 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-f67668b6-2334-44a8-8058-24881004d9cf admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 01 16:33:19.223963 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 8/16] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 1 16:33:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:33:19.283975 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-b0ddc1f4-20e0-4145-81a9-5b1d28621043 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 4096}} {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:33:19.302195 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-b0ddc1f4-20e0-4145-81a9-5b1d28621043 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072746 Jul 01 16:33:19.302786 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 9/17] 10.222.0.57 () {64 vars in 1282 bytes} [Fri Jul 1 16:33:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 16:33:19.316235 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-d450c01c-d061-4e7e-aae3-6b90434aa117 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:33:19.339656 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-d450c01c-d061-4e7e-aae3-6b90434aa117 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028564 Jul 01 16:33:19.340235 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 9/18] 10.222.0.57 () {64 vars in 1335 bytes} [Fri Jul 1 16:33:19 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:33:21.453304 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-b0ddc1f4-20e0-4145-81a9-5b1d28621043 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:33:21.454312 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-b0ddc1f4-20e0-4145-81a9-5b1d28621043 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001962 Jul 01 16:33:21.454994 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 10/19] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 1 16:33:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:33:21.514379 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-90f7c282-c568-43c1-aacf-919f129f1c93 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:33:21.539043 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-90f7c282-c568-43c1-aacf-919f129f1c93 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078283 Jul 01 16:33:21.539824 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 10/20] 10.222.0.57 () {60 vars in 1291 bytes} [Fri Jul 1 16:33:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:33:23.692187 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-b0ddc1f4-20e0-4145-81a9-5b1d28621043 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:33:23.693436 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-b0ddc1f4-20e0-4145-81a9-5b1d28621043 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001721 Jul 01 16:33:23.693835 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 11/21] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 1 16:33:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:33:23.753393 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-038bdfeb-cc36-40cc-8c34-a9d78df675c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "swap": 0}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:33:23.774316 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-038bdfeb-cc36-40cc-8c34-a9d78df675c5 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074513 Jul 01 16:33:23.775118 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 11/22] 10.222.0.57 () {64 vars in 1282 bytes} [Fri Jul 1 16:33:23 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 16:33:23.788861 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-8202fcfb-91d6-42c2-b8a2-6d00f6e4297a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:33:23.812808 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-8202fcfb-91d6-42c2-b8a2-6d00f6e4297a admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027626 Jul 01 16:33:23.813397 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 12/23] 10.222.0.57 () {64 vars in 1332 bytes} [Fri Jul 1 16:33:23 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:33:26.212723 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-038bdfeb-cc36-40cc-8c34-a9d78df675c5 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:33:26.214050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-038bdfeb-cc36-40cc-8c34-a9d78df675c5 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001893 Jul 01 16:33:26.214610 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 12/24] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 1 16:33:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:33:26.277383 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-faf34797-0330-4a7c-a434-c666758d70db admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 20, "id": "2", "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "name": "m1.small"}} {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:33:26.297123 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-faf34797-0330-4a7c-a434-c666758d70db admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074012 Jul 01 16:33:26.297792 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 13/25] 10.222.0.57 () {64 vars in 1282 bytes} [Fri Jul 1 16:33:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 16:33:26.310710 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-4a61f0d0-032c-47e6-ba0c-ad543b223d61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:33:26.341220 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-4a61f0d0-032c-47e6-ba0c-ad543b223d61 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033977 Jul 01 16:33:26.342065 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 13/26] 10.222.0.57 () {64 vars in 1332 bytes} [Fri Jul 1 16:33:26 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:33:28.463130 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-faf34797-0330-4a7c-a434-c666758d70db admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:33:28.464537 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-faf34797-0330-4a7c-a434-c666758d70db admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002112 Jul 01 16:33:28.465115 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 14/27] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 1 16:33:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:33:28.531083 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-bf4f00ad-fba4-41d7-b659-4d4e3c9b9ebb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 40, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "name": "m1.medium", "id": "3", "swap": 0}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:33:28.551064 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-bf4f00ad-fba4-41d7-b659-4d4e3c9b9ebb admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.078095 Jul 01 16:33:28.551616 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 14/28] 10.222.0.57 () {64 vars in 1282 bytes} [Fri Jul 1 16:33:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 16:33:28.565444 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-b1d1c8c2-7237-4fe2-8ddd-d6bc8f8eb995 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:33:28.593866 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-b1d1c8c2-7237-4fe2-8ddd-d6bc8f8eb995 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033978 Jul 01 16:33:28.594761 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 15/29] 10.222.0.57 () {64 vars in 1332 bytes} [Fri Jul 1 16:33:28 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:33:30.775692 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-bf4f00ad-fba4-41d7-b659-4d4e3c9b9ebb admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:33:30.776801 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-bf4f00ad-fba4-41d7-b659-4d4e3c9b9ebb admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Jul 01 16:33:30.777443 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 15/30] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 1 16:33:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:33:30.846446 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-474c6315-52ba-41e1-9c6d-179bc4ecea67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "4"}} {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:33:30.869233 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-474c6315-52ba-41e1-9c6d-179bc4ecea67 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085343 Jul 01 16:33:30.869786 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 16/31] 10.222.0.57 () {64 vars in 1282 bytes} [Fri Jul 1 16:33:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 16:33:30.883591 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-6190bdea-21c0-4539-bdcb-7c0a513a8a4c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:33:30.908148 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-6190bdea-21c0-4539-bdcb-7c0a513a8a4c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028504 Jul 01 16:33:30.908731 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 16/32] 10.222.0.57 () {64 vars in 1332 bytes} [Fri Jul 1 16:33:30 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:33:33.034722 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-474c6315-52ba-41e1-9c6d-179bc4ecea67 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:33:33.036417 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-474c6315-52ba-41e1-9c6d-179bc4ecea67 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002233 Jul 01 16:33:33.038784 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 17/33] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 1 16:33:33 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:33:33.109549 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-e0df3ac3-8f1c-4a52-af5d-aa8228ac5c5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "disk": 160, "id": "5", "swap": 0, "vcpus": 8, "ram": 16384, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:33:33.130618 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-e0df3ac3-8f1c-4a52-af5d-aa8228ac5c5a admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.087101 Jul 01 16:33:33.131365 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 17/34] 10.222.0.57 () {64 vars in 1282 bytes} [Fri Jul 1 16:33:33 2022] POST /compute/v2.1/flavors => generated 408 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 16:33:33.144567 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-a4bfc511-8bed-4a5c-8a6e-1111ab2b7f59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:33:33.194266 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-a4bfc511-8bed-4a5c-8a6e-1111ab2b7f59 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053844 Jul 01 16:33:33.195086 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 18/35] 10.222.0.57 () {64 vars in 1332 bytes} [Fri Jul 1 16:33:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:33:57.982002 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-e0df3ac3-8f1c-4a52-af5d-aa8228ac5c5a admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:33:57.983046 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-e0df3ac3-8f1c-4a52-af5d-aa8228ac5c5a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001931 Jul 01 16:33:57.983447 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 18/36] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 1 16:33:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:33:57.994033 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG dbcounter [-] [109826] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:33:58.043984 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-418a7f7c-f999-4963-9489-803743636a8a admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:33:58.061455 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-418a7f7c-f999-4963-9489-803743636a8a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071936 Jul 01 16:33:58.061986 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 19/37] 10.222.0.57 () {60 vars in 1291 bytes} [Fri Jul 1 16:33:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:33:58.995438 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-e0df3ac3-8f1c-4a52-af5d-aa8228ac5c5a admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:33:58.996477 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-e0df3ac3-8f1c-4a52-af5d-aa8228ac5c5a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jul 01 16:33:58.997047 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 19/38] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 1 16:33:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:33:59.197863 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-64091a0f-5809-4a6e-b826-3ab91b14c308 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:33:59.204189 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.wsgi [None req-64091a0f-5809-4a6e-b826-3ab91b14c308 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 01 16:33:59.207452 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-64091a0f-5809-4a6e-b826-3ab91b14c308 admin admin] Request method failure captured: Jul 01 16:33:59.207452 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 01 16:33:59.207452 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Accept: application/json Jul 01 16:33:59.207452 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Accept-Encoding: gzip, deflate Jul 01 16:33:59.207452 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Connection: keep-alive Jul 01 16:33:59.207452 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Content-Length: 0 Jul 01 16:33:59.207452 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Host: 10.222.0.57 Jul 01 16:33:59.207452 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Openstack-Api-Version: compute 2.90 Jul 01 16:33:59.207452 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Openstack-System-Scope: None Jul 01 16:33:59.207452 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: User-Agent: python-novaclient Jul 01 16:33:59.207452 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Auth-Token: gAAAAABivyH2QgQHOebC-qMVoyJzCCGyCrYM800L6Q_tru8oUe_LDaGRweeeOOy6a3YQ7dpu7i3XaC4fJVYHmGRODkI2La6Gkc4DugPahpcITqeDJQFS_ulJWKxPAjpF1lOur96rRHl4ggCugOOcXsYcAHDX-t5qpPzLmMNa_eVCvCIjXA1LPHM Jul 01 16:33:59.207452 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Domain-Id: None Jul 01 16:33:59.207452 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Domain-Name: None Jul 01 16:33:59.207452 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Identity-Status: Confirmed Jul 01 16:33:59.207452 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Is-Admin-Project: True Jul 01 16:33:59.207452 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 16:33:59.207452 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Project-Domain-Id: default Jul 01 16:33:59.207452 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Project-Domain-Name: Default Jul 01 16:33:59.207452 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Project-Id: 62a34c02685249b399e8facc39cc11f8 Jul 01 16:33:59.207452 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Project-Name: admin Jul 01 16:33:59.207452 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Role: admin,member,reader Jul 01 16:33:59.207452 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Roles: admin,member,reader Jul 01 16:33:59.209062 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/62a34c02685249b399e8facc39cc11f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/62a34c02685249b399e8facc39cc11f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_62a34c02685249b399e8facc39cc11f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/62a34c02685249b399e8facc39cc11f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:33:59.209062 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Tenant: admin Jul 01 16:33:59.209062 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Tenant-Id: 62a34c02685249b399e8facc39cc11f8 Jul 01 16:33:59.209062 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Tenant-Name: admin Jul 01 16:33:59.209062 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-User: admin Jul 01 16:33:59.209062 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-User-Domain-Id: default Jul 01 16:33:59.209062 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-User-Domain-Name: Default Jul 01 16:33:59.209062 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-User-Id: 9996f66c673f4673ab2342b66da9acc2 Jul 01 16:33:59.209062 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-User-Name: admin Jul 01 16:33:59.209062 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: method: > Jul 01 16:33:59.209062 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: exception: Flavor 42 could not be found. Jul 01 16:33:59.209062 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: action_args: {'id': '42'} Jul 01 16:33:59.209062 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:33:59.209062 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:33:59.210068 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 16:33:59.210068 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 16:33:59.210068 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 16:33:59.210068 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 16:33:59.210068 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 16:33:59.210068 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 16:33:59.210068 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 16:33:59.210068 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 16:33:59.210068 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 16:33:59.210068 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:33:59.210068 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 16:33:59.210068 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 16:33:59.210068 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 01 16:33:59.210068 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jul 01 16:33:59.210068 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:33:59.210068 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jul 01 16:33:59.210068 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:33:59.210068 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:33:59.210068 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:33:59.211650 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:33:59.211650 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:33:59.211650 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:33:59.211650 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:33:59.211650 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 16:33:59.211650 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:33:59.211650 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 01 16:33:59.211650 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jul 01 16:33:59.211650 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:33:59.211650 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jul 01 16:33:59.211650 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:33:59.211650 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:33:59.211650 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:33:59.211650 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:33:59.211650 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:33:59.211650 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 01 16:33:59.211650 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jul 01 16:33:59.211650 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-64091a0f-5809-4a6e-b826-3ab91b14c308 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:33:59.213101 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-64091a0f-5809-4a6e-b826-3ab91b14c308 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062637 Jul 01 16:33:59.213101 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 20/39] 10.222.0.57 () {60 vars in 1190 bytes} [Fri Jul 1 16:33:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 16:33:59.219399 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-af601d51-0623-4857-bb05-cf2afd841550 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:33:59.222406 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:33:59.242404 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-af601d51-0623-4857-bb05-cf2afd841550 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027442 Jul 01 16:33:59.242953 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 20/40] 10.222.0.57 () {60 vars in 1210 bytes} [Fri Jul 1 16:33:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:33:59.252831 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-6e533eb3-843e-4d97-a08c-bfd871bd5a59 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:33:59.274303 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-6e533eb3-843e-4d97-a08c-bfd871bd5a59 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025013 Jul 01 16:33:59.274884 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 21/41] 10.222.0.57 () {60 vars in 1210 bytes} [Fri Jul 1 16:33:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:33:59.284703 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-aea859d4-c1e8-41dd-9df5-0e91b6546d79 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:33:59.291190 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.wsgi [None req-aea859d4-c1e8-41dd-9df5-0e91b6546d79 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 01 16:33:59.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-aea859d4-c1e8-41dd-9df5-0e91b6546d79 admin admin] Request method failure captured: Jul 01 16:33:59.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 01 16:33:59.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Accept: application/json Jul 01 16:33:59.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Accept-Encoding: gzip, deflate Jul 01 16:33:59.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Connection: keep-alive Jul 01 16:33:59.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Content-Length: 0 Jul 01 16:33:59.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Host: 10.222.0.57 Jul 01 16:33:59.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Openstack-Api-Version: compute 2.90 Jul 01 16:33:59.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Openstack-System-Scope: None Jul 01 16:33:59.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: User-Agent: python-novaclient Jul 01 16:33:59.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Auth-Token: gAAAAABivyH2QgQHOebC-qMVoyJzCCGyCrYM800L6Q_tru8oUe_LDaGRweeeOOy6a3YQ7dpu7i3XaC4fJVYHmGRODkI2La6Gkc4DugPahpcITqeDJQFS_ulJWKxPAjpF1lOur96rRHl4ggCugOOcXsYcAHDX-t5qpPzLmMNa_eVCvCIjXA1LPHM Jul 01 16:33:59.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Domain-Id: None Jul 01 16:33:59.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Domain-Name: None Jul 01 16:33:59.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Identity-Status: Confirmed Jul 01 16:33:59.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Is-Admin-Project: True Jul 01 16:33:59.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 16:33:59.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Project-Domain-Id: default Jul 01 16:33:59.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Project-Domain-Name: Default Jul 01 16:33:59.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Project-Id: 62a34c02685249b399e8facc39cc11f8 Jul 01 16:33:59.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Project-Name: admin Jul 01 16:33:59.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Role: admin,member,reader Jul 01 16:33:59.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Roles: admin,member,reader Jul 01 16:33:59.296669 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/62a34c02685249b399e8facc39cc11f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/62a34c02685249b399e8facc39cc11f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_62a34c02685249b399e8facc39cc11f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/62a34c02685249b399e8facc39cc11f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:33:59.296669 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Tenant: admin Jul 01 16:33:59.296669 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Tenant-Id: 62a34c02685249b399e8facc39cc11f8 Jul 01 16:33:59.296669 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Tenant-Name: admin Jul 01 16:33:59.296669 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-User: admin Jul 01 16:33:59.296669 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-User-Domain-Id: default Jul 01 16:33:59.296669 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-User-Domain-Name: Default Jul 01 16:33:59.296669 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-User-Id: 9996f66c673f4673ab2342b66da9acc2 Jul 01 16:33:59.296669 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-User-Name: admin Jul 01 16:33:59.296669 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: method: > Jul 01 16:33:59.296669 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: exception: Flavor 42 could not be found. Jul 01 16:33:59.296669 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: action_args: {'id': '42'} Jul 01 16:33:59.296669 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:33:59.296669 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:33:59.297708 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 16:33:59.297708 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 16:33:59.297708 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 16:33:59.297708 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 16:33:59.297708 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 16:33:59.297708 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 16:33:59.297708 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 16:33:59.297708 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 16:33:59.297708 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 16:33:59.297708 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:33:59.297708 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 16:33:59.297708 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 16:33:59.297708 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 01 16:33:59.297708 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jul 01 16:33:59.297708 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:33:59.297708 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jul 01 16:33:59.297708 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:33:59.297708 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:33:59.297708 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:33:59.299100 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:33:59.299100 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:33:59.299100 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:33:59.299100 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:33:59.299100 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 16:33:59.299100 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:33:59.299100 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 01 16:33:59.299100 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jul 01 16:33:59.299100 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:33:59.299100 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jul 01 16:33:59.299100 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:33:59.299100 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:33:59.299100 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:33:59.299100 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:33:59.299100 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:33:59.299100 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 01 16:33:59.299100 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jul 01 16:33:59.299100 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-aea859d4-c1e8-41dd-9df5-0e91b6546d79 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:33:59.300456 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-aea859d4-c1e8-41dd-9df5-0e91b6546d79 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015321 Jul 01 16:33:59.300456 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 21/42] 10.222.0.57 () {60 vars in 1190 bytes} [Fri Jul 1 16:33:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 16:34:00.125676 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-6e533eb3-843e-4d97-a08c-bfd871bd5a59 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:34:00.126716 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-6e533eb3-843e-4d97-a08c-bfd871bd5a59 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 01 16:34:00.127122 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 22/43] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 1 16:34:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:34:00.320052 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-60825efc-d9d0-4d65-a504-dadb6ebcdd2e admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:34:00.326517 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.wsgi [None req-60825efc-d9d0-4d65-a504-dadb6ebcdd2e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 01 16:34:00.328050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-60825efc-d9d0-4d65-a504-dadb6ebcdd2e admin admin] Request method failure captured: Jul 01 16:34:00.328050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 01 16:34:00.328050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Accept: application/json Jul 01 16:34:00.328050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Accept-Encoding: gzip, deflate Jul 01 16:34:00.328050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Connection: keep-alive Jul 01 16:34:00.328050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Content-Length: 0 Jul 01 16:34:00.328050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Host: 10.222.0.57 Jul 01 16:34:00.328050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Openstack-Api-Version: compute 2.90 Jul 01 16:34:00.328050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Openstack-System-Scope: None Jul 01 16:34:00.328050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: User-Agent: python-novaclient Jul 01 16:34:00.328050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Auth-Token: gAAAAABivyH4zSdXmf7bWmek9-AiV16CHE4mfzJppTxmx8veSbOaPxN0YgeVrqS8HkN-sBoLCqjWzx7JLb75lz6wj9n49GTtno8yPDvGt6b4c7DKOCrGPkqbk2pwULNRihfoHJpLsfom5cmR7mfb3PR1m4gSBoBqfHEA2F162DfyPJyHFIuFkzA Jul 01 16:34:00.328050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Domain-Id: None Jul 01 16:34:00.328050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Domain-Name: None Jul 01 16:34:00.328050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Identity-Status: Confirmed Jul 01 16:34:00.328050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Is-Admin-Project: True Jul 01 16:34:00.328050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 16:34:00.328050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Project-Domain-Id: default Jul 01 16:34:00.328050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Project-Domain-Name: Default Jul 01 16:34:00.328050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Project-Id: 62a34c02685249b399e8facc39cc11f8 Jul 01 16:34:00.328050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Project-Name: admin Jul 01 16:34:00.328050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Role: admin,member,reader Jul 01 16:34:00.328050 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Roles: admin,member,reader Jul 01 16:34:00.330299 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/62a34c02685249b399e8facc39cc11f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/62a34c02685249b399e8facc39cc11f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_62a34c02685249b399e8facc39cc11f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/62a34c02685249b399e8facc39cc11f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:34:00.330299 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Tenant: admin Jul 01 16:34:00.330299 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Tenant-Id: 62a34c02685249b399e8facc39cc11f8 Jul 01 16:34:00.330299 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Tenant-Name: admin Jul 01 16:34:00.330299 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-User: admin Jul 01 16:34:00.330299 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-User-Domain-Id: default Jul 01 16:34:00.330299 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-User-Domain-Name: Default Jul 01 16:34:00.330299 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-User-Id: 9996f66c673f4673ab2342b66da9acc2 Jul 01 16:34:00.330299 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-User-Name: admin Jul 01 16:34:00.330299 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: method: > Jul 01 16:34:00.330299 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: exception: Flavor 84 could not be found. Jul 01 16:34:00.330299 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: action_args: {'id': '84'} Jul 01 16:34:00.330299 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:34:00.330299 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:34:00.331858 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 16:34:00.331858 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 16:34:00.331858 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 16:34:00.331858 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 16:34:00.331858 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 16:34:00.331858 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 16:34:00.331858 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 16:34:00.331858 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 16:34:00.331858 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 16:34:00.331858 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:34:00.331858 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 16:34:00.331858 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 16:34:00.331858 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 01 16:34:00.331858 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jul 01 16:34:00.331858 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:34:00.331858 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jul 01 16:34:00.331858 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:34:00.331858 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:34:00.331858 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:34:00.333952 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:34:00.333952 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:34:00.333952 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:34:00.333952 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:34:00.333952 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 16:34:00.333952 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:34:00.333952 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 01 16:34:00.333952 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jul 01 16:34:00.333952 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:34:00.333952 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jul 01 16:34:00.333952 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:34:00.333952 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:34:00.333952 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:34:00.333952 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:34:00.333952 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:34:00.333952 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 01 16:34:00.333952 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jul 01 16:34:00.333952 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-60825efc-d9d0-4d65-a504-dadb6ebcdd2e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:34:00.336261 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-60825efc-d9d0-4d65-a504-dadb6ebcdd2e admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063053 Jul 01 16:34:00.336261 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 22/44] 10.222.0.57 () {60 vars in 1190 bytes} [Fri Jul 1 16:34:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 16:34:00.341341 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-4870643f-0993-44d1-b195-b045f1a4e482 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:34:00.356546 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-4870643f-0993-44d1-b195-b045f1a4e482 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019365 Jul 01 16:34:00.357069 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 23/45] 10.222.0.57 () {60 vars in 1210 bytes} [Fri Jul 1 16:34:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:34:00.366587 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-c78ecf62-93fc-43d4-a06f-947a630f5b01 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:34:00.381669 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-c78ecf62-93fc-43d4-a06f-947a630f5b01 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018566 Jul 01 16:34:00.382180 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 23/46] 10.222.0.57 () {60 vars in 1210 bytes} [Fri Jul 1 16:34:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:34:00.392083 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-b591d447-a459-467c-a957-ad83753f9ecd admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:34:00.398252 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.wsgi [None req-b591d447-a459-467c-a957-ad83753f9ecd admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 01 16:34:00.399817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-b591d447-a459-467c-a957-ad83753f9ecd admin admin] Request method failure captured: Jul 01 16:34:00.399817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 01 16:34:00.399817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Accept: application/json Jul 01 16:34:00.399817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Accept-Encoding: gzip, deflate Jul 01 16:34:00.399817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Connection: keep-alive Jul 01 16:34:00.399817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Content-Length: 0 Jul 01 16:34:00.399817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Host: 10.222.0.57 Jul 01 16:34:00.399817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Openstack-Api-Version: compute 2.90 Jul 01 16:34:00.399817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Openstack-System-Scope: None Jul 01 16:34:00.399817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: User-Agent: python-novaclient Jul 01 16:34:00.399817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Auth-Token: gAAAAABivyH4zSdXmf7bWmek9-AiV16CHE4mfzJppTxmx8veSbOaPxN0YgeVrqS8HkN-sBoLCqjWzx7JLb75lz6wj9n49GTtno8yPDvGt6b4c7DKOCrGPkqbk2pwULNRihfoHJpLsfom5cmR7mfb3PR1m4gSBoBqfHEA2F162DfyPJyHFIuFkzA Jul 01 16:34:00.399817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Domain-Id: None Jul 01 16:34:00.399817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Domain-Name: None Jul 01 16:34:00.399817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Identity-Status: Confirmed Jul 01 16:34:00.399817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Is-Admin-Project: True Jul 01 16:34:00.399817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 16:34:00.399817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Project-Domain-Id: default Jul 01 16:34:00.399817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Project-Domain-Name: Default Jul 01 16:34:00.399817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Project-Id: 62a34c02685249b399e8facc39cc11f8 Jul 01 16:34:00.399817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Project-Name: admin Jul 01 16:34:00.399817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Role: admin,member,reader Jul 01 16:34:00.399817 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Roles: admin,member,reader Jul 01 16:34:00.401354 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/62a34c02685249b399e8facc39cc11f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/62a34c02685249b399e8facc39cc11f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_62a34c02685249b399e8facc39cc11f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/62a34c02685249b399e8facc39cc11f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:34:00.401354 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Tenant: admin Jul 01 16:34:00.401354 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Tenant-Id: 62a34c02685249b399e8facc39cc11f8 Jul 01 16:34:00.401354 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Tenant-Name: admin Jul 01 16:34:00.401354 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-User: admin Jul 01 16:34:00.401354 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-User-Domain-Id: default Jul 01 16:34:00.401354 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-User-Domain-Name: Default Jul 01 16:34:00.401354 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-User-Id: 9996f66c673f4673ab2342b66da9acc2 Jul 01 16:34:00.401354 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-User-Name: admin Jul 01 16:34:00.401354 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: method: > Jul 01 16:34:00.401354 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: exception: Flavor 84 could not be found. Jul 01 16:34:00.401354 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: action_args: {'id': '84'} Jul 01 16:34:00.401354 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:34:00.401354 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:34:00.402214 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 16:34:00.402214 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 16:34:00.402214 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 16:34:00.402214 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 16:34:00.402214 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 16:34:00.402214 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 16:34:00.402214 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 16:34:00.402214 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 16:34:00.402214 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 16:34:00.402214 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:34:00.402214 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 16:34:00.402214 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 16:34:00.402214 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 01 16:34:00.402214 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jul 01 16:34:00.402214 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:34:00.402214 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jul 01 16:34:00.402214 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:34:00.402214 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:34:00.402214 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:34:00.404646 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:34:00.404646 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:34:00.404646 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:34:00.404646 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:34:00.404646 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 16:34:00.404646 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:34:00.404646 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 01 16:34:00.404646 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jul 01 16:34:00.404646 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:34:00.404646 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jul 01 16:34:00.404646 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:34:00.404646 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:34:00.404646 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:34:00.404646 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:34:00.404646 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:34:00.404646 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 01 16:34:00.404646 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jul 01 16:34:00.404646 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-b591d447-a459-467c-a957-ad83753f9ecd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:34:00.405932 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-b591d447-a459-467c-a957-ad83753f9ecd admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012697 Jul 01 16:34:00.405932 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 24/47] 10.222.0.57 () {60 vars in 1190 bytes} [Fri Jul 1 16:34:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 16:34:01.239354 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-c78ecf62-93fc-43d4-a06f-947a630f5b01 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:34:01.240381 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-c78ecf62-93fc-43d4-a06f-947a630f5b01 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 01 16:34:01.240786 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 24/48] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 1 16:34:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:34:01.432737 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-b34e7578-bee6-492f-87bc-681a6ce870d1 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:34:01.439049 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.wsgi [None req-b34e7578-bee6-492f-87bc-681a6ce870d1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 01 16:34:01.440597 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-b34e7578-bee6-492f-87bc-681a6ce870d1 admin admin] Request method failure captured: Jul 01 16:34:01.440597 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 01 16:34:01.440597 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Accept: application/json Jul 01 16:34:01.440597 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Accept-Encoding: gzip, deflate Jul 01 16:34:01.440597 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Connection: keep-alive Jul 01 16:34:01.440597 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Content-Length: 0 Jul 01 16:34:01.440597 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Host: 10.222.0.57 Jul 01 16:34:01.440597 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Openstack-Api-Version: compute 2.90 Jul 01 16:34:01.440597 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Openstack-System-Scope: None Jul 01 16:34:01.440597 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: User-Agent: python-novaclient Jul 01 16:34:01.440597 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Auth-Token: gAAAAABivyH5OloAvy2TrdK9CSYq7ZAba5MYqZmXN4Lmq1u3_jbe9Aymvb5ENF1mqmhSz8FROphm76-pWn37JlUzQAa-B7IvGuy8PQbZhGVi_le063qeuIktQEs6O72u6iPbVg9CMqBHk6Pwi2nJ9QO3xpjhWDi4YDk4u8WporbLIiHfisFh2UQ Jul 01 16:34:01.440597 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Domain-Id: None Jul 01 16:34:01.440597 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Domain-Name: None Jul 01 16:34:01.440597 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Identity-Status: Confirmed Jul 01 16:34:01.440597 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Is-Admin-Project: True Jul 01 16:34:01.440597 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 16:34:01.440597 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Project-Domain-Id: default Jul 01 16:34:01.440597 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Project-Domain-Name: Default Jul 01 16:34:01.440597 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Project-Id: 62a34c02685249b399e8facc39cc11f8 Jul 01 16:34:01.440597 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Project-Name: admin Jul 01 16:34:01.440597 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Role: admin,member,reader Jul 01 16:34:01.440597 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Roles: admin,member,reader Jul 01 16:34:01.442390 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/62a34c02685249b399e8facc39cc11f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/62a34c02685249b399e8facc39cc11f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_62a34c02685249b399e8facc39cc11f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/62a34c02685249b399e8facc39cc11f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:34:01.442390 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Tenant: admin Jul 01 16:34:01.442390 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Tenant-Id: 62a34c02685249b399e8facc39cc11f8 Jul 01 16:34:01.442390 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-Tenant-Name: admin Jul 01 16:34:01.442390 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-User: admin Jul 01 16:34:01.442390 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-User-Domain-Id: default Jul 01 16:34:01.442390 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-User-Domain-Name: Default Jul 01 16:34:01.442390 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-User-Id: 9996f66c673f4673ab2342b66da9acc2 Jul 01 16:34:01.442390 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: X-User-Name: admin Jul 01 16:34:01.442390 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: method: > Jul 01 16:34:01.442390 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: exception: Flavor 451 could not be found. Jul 01 16:34:01.442390 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: action_args: {'id': '451'} Jul 01 16:34:01.442390 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:34:01.442390 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:34:01.443186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 16:34:01.443186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 16:34:01.443186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 16:34:01.443186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 16:34:01.443186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 16:34:01.443186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 16:34:01.443186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 16:34:01.443186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 16:34:01.443186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 16:34:01.443186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:34:01.443186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 16:34:01.443186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 16:34:01.443186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 01 16:34:01.443186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jul 01 16:34:01.443186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:34:01.443186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jul 01 16:34:01.443186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:34:01.443186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:34:01.443186 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:34:01.444288 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:34:01.444288 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:34:01.444288 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:34:01.444288 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:34:01.444288 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 16:34:01.444288 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:34:01.444288 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 01 16:34:01.444288 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jul 01 16:34:01.444288 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:34:01.444288 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jul 01 16:34:01.444288 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:34:01.444288 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:34:01.444288 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:34:01.444288 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:34:01.444288 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:34:01.444288 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 01 16:34:01.444288 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: ERROR nova.api.openstack.wsgi Jul 01 16:34:01.444288 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-b34e7578-bee6-492f-87bc-681a6ce870d1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:34:01.445310 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-b34e7578-bee6-492f-87bc-681a6ce870d1 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061461 Jul 01 16:34:01.445310 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 25/49] 10.222.0.57 () {60 vars in 1193 bytes} [Fri Jul 1 16:34:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 16:34:01.452510 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-188275ad-0710-4c4a-b8f1-56ed44dfff02 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:34:01.465865 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-188275ad-0710-4c4a-b8f1-56ed44dfff02 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017537 Jul 01 16:34:01.466393 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 25/50] 10.222.0.57 () {60 vars in 1210 bytes} [Fri Jul 1 16:34:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:34:01.475590 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-30d13678-b285-4e3c-a397-22a342a650ec admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:34:01.489201 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-30d13678-b285-4e3c-a397-22a342a650ec admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017057 Jul 01 16:34:01.489720 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 26/51] 10.222.0.57 () {60 vars in 1210 bytes} [Fri Jul 1 16:34:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:34:01.499395 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-692f4f60-09bd-44df-8454-0be55fe8715d admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:34:01.504686 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.wsgi [None req-692f4f60-09bd-44df-8454-0be55fe8715d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 01 16:34:01.506172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-692f4f60-09bd-44df-8454-0be55fe8715d admin admin] Request method failure captured: Jul 01 16:34:01.506172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 01 16:34:01.506172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Accept: application/json Jul 01 16:34:01.506172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Accept-Encoding: gzip, deflate Jul 01 16:34:01.506172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Connection: keep-alive Jul 01 16:34:01.506172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Content-Length: 0 Jul 01 16:34:01.506172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Host: 10.222.0.57 Jul 01 16:34:01.506172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Openstack-Api-Version: compute 2.90 Jul 01 16:34:01.506172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Openstack-System-Scope: None Jul 01 16:34:01.506172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: User-Agent: python-novaclient Jul 01 16:34:01.506172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Auth-Token: gAAAAABivyH5OloAvy2TrdK9CSYq7ZAba5MYqZmXN4Lmq1u3_jbe9Aymvb5ENF1mqmhSz8FROphm76-pWn37JlUzQAa-B7IvGuy8PQbZhGVi_le063qeuIktQEs6O72u6iPbVg9CMqBHk6Pwi2nJ9QO3xpjhWDi4YDk4u8WporbLIiHfisFh2UQ Jul 01 16:34:01.506172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Domain-Id: None Jul 01 16:34:01.506172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Domain-Name: None Jul 01 16:34:01.506172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Identity-Status: Confirmed Jul 01 16:34:01.506172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Is-Admin-Project: True Jul 01 16:34:01.506172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 16:34:01.506172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Project-Domain-Id: default Jul 01 16:34:01.506172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Project-Domain-Name: Default Jul 01 16:34:01.506172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Project-Id: 62a34c02685249b399e8facc39cc11f8 Jul 01 16:34:01.506172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Project-Name: admin Jul 01 16:34:01.506172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Role: admin,member,reader Jul 01 16:34:01.506172 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Roles: admin,member,reader Jul 01 16:34:01.507765 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/62a34c02685249b399e8facc39cc11f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/62a34c02685249b399e8facc39cc11f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_62a34c02685249b399e8facc39cc11f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/62a34c02685249b399e8facc39cc11f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:34:01.507765 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Tenant: admin Jul 01 16:34:01.507765 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Tenant-Id: 62a34c02685249b399e8facc39cc11f8 Jul 01 16:34:01.507765 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-Tenant-Name: admin Jul 01 16:34:01.507765 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-User: admin Jul 01 16:34:01.507765 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-User-Domain-Id: default Jul 01 16:34:01.507765 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-User-Domain-Name: Default Jul 01 16:34:01.507765 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-User-Id: 9996f66c673f4673ab2342b66da9acc2 Jul 01 16:34:01.507765 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: X-User-Name: admin Jul 01 16:34:01.507765 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: method: > Jul 01 16:34:01.507765 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: exception: Flavor 451 could not be found. Jul 01 16:34:01.507765 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: action_args: {'id': '451'} Jul 01 16:34:01.507765 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:34:01.507765 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:34:01.508724 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 16:34:01.508724 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 16:34:01.508724 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 16:34:01.508724 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 16:34:01.508724 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 16:34:01.508724 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 16:34:01.508724 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 16:34:01.508724 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 16:34:01.508724 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 16:34:01.508724 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:34:01.508724 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 16:34:01.508724 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 16:34:01.508724 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 01 16:34:01.508724 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jul 01 16:34:01.508724 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:34:01.508724 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jul 01 16:34:01.508724 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:34:01.508724 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:34:01.508724 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:34:01.510149 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:34:01.510149 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:34:01.510149 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:34:01.510149 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:34:01.510149 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 16:34:01.510149 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:34:01.510149 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 01 16:34:01.510149 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jul 01 16:34:01.510149 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:34:01.510149 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jul 01 16:34:01.510149 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:34:01.510149 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:34:01.510149 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:34:01.510149 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:34:01.510149 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:34:01.510149 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 01 16:34:01.510149 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: ERROR nova.api.openstack.wsgi Jul 01 16:34:01.510149 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-692f4f60-09bd-44df-8454-0be55fe8715d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:34:01.511496 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-692f4f60-09bd-44df-8454-0be55fe8715d admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012209 Jul 01 16:34:01.511496 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 26/52] 10.222.0.57 () {60 vars in 1193 bytes} [Fri Jul 1 16:34:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 01 16:34:02.341167 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-30d13678-b285-4e3c-a397-22a342a650ec admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:34:02.342237 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-30d13678-b285-4e3c-a397-22a342a650ec admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001650 Jul 01 16:34:02.342667 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 27/53] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 1 16:34:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:34:02.534085 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-8b2c9af5-fda2-46bd-96d8-1060547bc2e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:34:02.551876 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-8b2c9af5-fda2-46bd-96d8-1060547bc2e6 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069336 Jul 01 16:34:02.552353 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 27/54] 10.222.0.57 () {64 vars in 1235 bytes} [Fri Jul 1 16:34:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 16:34:03.390518 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-30d13678-b285-4e3c-a397-22a342a650ec admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:34:03.391525 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-30d13678-b285-4e3c-a397-22a342a650ec admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 01 16:34:03.391949 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 28/55] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 1 16:34:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:34:03.589331 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-13c69688-6f1c-41e7-bba1-27c71d03c8c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:34:03.608160 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-13c69688-6f1c-41e7-bba1-27c71d03c8c7 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.077193 Jul 01 16:34:03.608625 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 28/56] 10.222.0.57 () {64 vars in 1235 bytes} [Fri Jul 1 16:34:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 16:34:04.449949 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-30d13678-b285-4e3c-a397-22a342a650ec admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:34:04.450964 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-30d13678-b285-4e3c-a397-22a342a650ec admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 01 16:34:04.451357 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 29/57] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 1 16:34:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:34:04.642290 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-2a4533e9-9347-4940-8e7a-ba6930ab44fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:34:04.660279 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-2a4533e9-9347-4940-8e7a-ba6930ab44fd admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070496 Jul 01 16:34:04.660815 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 29/58] 10.222.0.57 () {64 vars in 1235 bytes} [Fri Jul 1 16:34:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 16:34:05.486502 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-30d13678-b285-4e3c-a397-22a342a650ec admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:34:05.487501 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-30d13678-b285-4e3c-a397-22a342a650ec admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 01 16:34:05.487904 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 30/59] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 1 16:34:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:34:05.679556 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-25a971cf-5b52-4979-b7e1-104a31a6981c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:34:05.697383 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-25a971cf-5b52-4979-b7e1-104a31a6981c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069995 Jul 01 16:34:05.697852 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 30/60] 10.222.0.57 () {64 vars in 1235 bytes} [Fri Jul 1 16:34:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 16:34:06.527864 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-30d13678-b285-4e3c-a397-22a342a650ec admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:34:06.528853 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-30d13678-b285-4e3c-a397-22a342a650ec admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001628 Jul 01 16:34:06.529245 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 31/61] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 1 16:34:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:34:06.721603 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-7bf157a6-aaf1-4587-b021-8feed0873dae admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:34:06.741682 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-7bf157a6-aaf1-4587-b021-8feed0873dae admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072371 Jul 01 16:34:06.742215 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 31/62] 10.222.0.57 () {60 vars in 1202 bytes} [Fri Jul 1 16:34:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:34:54.455331 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-30d13678-b285-4e3c-a397-22a342a650ec admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:34:54.456371 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-30d13678-b285-4e3c-a397-22a342a650ec admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 01 16:34:54.456800 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 32/63] 10.222.0.57 () {54 vars in 930 bytes} [Fri Jul 1 16:34:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:34:54.467307 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:34:54.517205 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-149cfbc0-b792-4b51-ad75-2dffc0adac02 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:34:54.536066 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-149cfbc0-b792-4b51-ad75-2dffc0adac02 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073361 Jul 01 16:34:54.536595 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 32/64] 10.222.0.57 () {60 vars in 1291 bytes} [Fri Jul 1 16:34:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:34:54.560427 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-f94f2efc-9b5e-4f9b-9a83-20784fdcc7b8 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:34:54.564567 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG dbcounter [-] [109826] Writing DB stats nova_api:SELECT=14 {{(pid=109826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:34:54.569837 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-f94f2efc-9b5e-4f9b-9a83-20784fdcc7b8 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013302 Jul 01 16:34:54.570384 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 33/65] 10.222.0.57 () {60 vars in 1282 bytes} [Fri Jul 1 16:34:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:34:54.582274 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-3c476656-7d69-43c5-a227-06336d4f0501 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:34:54.589764 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-3c476656-7d69-43c5-a227-06336d4f0501 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011176 Jul 01 16:34:54.590283 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 33/66] 10.222.0.57 () {60 vars in 1285 bytes} [Fri Jul 1 16:34:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:34:54.601698 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-bed5cbe8-fa2e-4dbc-8bbb-21149e2a00a2 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:34:54.609839 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-bed5cbe8-fa2e-4dbc-8bbb-21149e2a00a2 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011554 Jul 01 16:34:54.610429 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 34/67] 10.222.0.57 () {60 vars in 1285 bytes} [Fri Jul 1 16:34:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:34:54.621662 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-6f4a43fb-8abb-4780-9bc8-ea749b0ccaf4 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:34:54.630298 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-6f4a43fb-8abb-4780-9bc8-ea749b0ccaf4 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012271 Jul 01 16:34:54.630842 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 34/68] 10.222.0.57 () {60 vars in 1282 bytes} [Fri Jul 1 16:34:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:38:15.557239 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-bed5cbe8-fa2e-4dbc-8bbb-21149e2a00a2 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:38:15.558269 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-bed5cbe8-fa2e-4dbc-8bbb-21149e2a00a2 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jul 01 16:38:15.558702 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 35/69] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 1 16:38:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:38:15.709223 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writing DB stats nova_api:SELECT=6 {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:38:15.822242 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-178220e6-de95-47a2-ae15-869768cb1eae admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:38:15.823478 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:38:15.823478 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: warnings.warn(msg) Jul 01 16:38:15.824778 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-178220e6-de95-47a2-ae15-869768cb1eae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:38:15.825244 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-178220e6-de95-47a2-ae15-869768cb1eae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:38:15.826075 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-178220e6-de95-47a2-ae15-869768cb1eae admin admin] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:38:15.826573 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-178220e6-de95-47a2-ae15-869768cb1eae admin admin] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:38:15.861362 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-178220e6-de95-47a2-ae15-869768cb1eae admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.154540 Jul 01 16:38:15.861927 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 35/70] 10.222.0.57 () {60 vars in 1193 bytes} [Fri Jul 1 16:38:15 2022] GET /compute/v2.1/os-services => generated 794 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 16:38:16.710492 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-bed5cbe8-fa2e-4dbc-8bbb-21149e2a00a2 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:38:16.711558 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-bed5cbe8-fa2e-4dbc-8bbb-21149e2a00a2 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 01 16:38:16.711956 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 36/71] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 1 16:38:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:38:16.910057 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-c212bfe6-9237-45ad-bde7-11e17c36e000 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:38:16.911296 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:38:16.911296 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: warnings.warn(msg) Jul 01 16:38:16.913294 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-c212bfe6-9237-45ad-bde7-11e17c36e000 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:38:16.913734 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-c212bfe6-9237-45ad-bde7-11e17c36e000 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:38:16.914562 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-c212bfe6-9237-45ad-bde7-11e17c36e000 admin admin] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:38:16.914995 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-c212bfe6-9237-45ad-bde7-11e17c36e000 admin admin] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:38:16.934234 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-c212bfe6-9237-45ad-bde7-11e17c36e000 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.078317 Jul 01 16:38:16.934810 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 36/72] 10.222.0.57 () {60 vars in 1193 bytes} [Fri Jul 1 16:38:16 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 16:38:28.193202 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-bed5cbe8-fa2e-4dbc-8bbb-21149e2a00a2 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:38:28.194195 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-bed5cbe8-fa2e-4dbc-8bbb-21149e2a00a2 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 01 16:38:28.194621 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 37/73] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 1 16:38:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:38:28.350227 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writing DB stats nova_cell0:SELECT=4 {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:38:28.350971 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writing DB stats nova_cell1:SELECT=4 {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:38:28.351584 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG dbcounter [-] [109827] Writing DB stats nova_api:SELECT=8 {{(pid=109827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:38:28.400648 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-e5c7b9f3-de5f-4fd0-98c8-75ecf3ee2ffc admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:38:28.401826 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:38:28.401826 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: warnings.warn(msg) Jul 01 16:38:28.403152 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-e5c7b9f3-de5f-4fd0-98c8-75ecf3ee2ffc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:38:28.403528 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-e5c7b9f3-de5f-4fd0-98c8-75ecf3ee2ffc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:38:28.404294 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-e5c7b9f3-de5f-4fd0-98c8-75ecf3ee2ffc admin admin] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:38:28.404713 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-e5c7b9f3-de5f-4fd0-98c8-75ecf3ee2ffc admin admin] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:38:28.428719 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-e5c7b9f3-de5f-4fd0-98c8-75ecf3ee2ffc admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083947 Jul 01 16:38:28.429246 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 37/74] 10.222.0.57 () {60 vars in 1193 bytes} [Fri Jul 1 16:38:28 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:38:29.268419 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: DEBUG nova.api.openstack.wsgi [None req-bed5cbe8-fa2e-4dbc-8bbb-21149e2a00a2 admin admin] Calling method '>' {{(pid=109826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:38:29.269429 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: INFO nova.api.openstack.requestlog [None req-bed5cbe8-fa2e-4dbc-8bbb-21149e2a00a2 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jul 01 16:38:29.269830 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: [pid: 109826|app: 0|req: 38/75] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Jul 1 16:38:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:38:29.465060 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG nova.api.openstack.wsgi [None req-2fbe5574-5384-4566-9a0d-9c4555091393 admin admin] Calling method '>' {{(pid=109827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:38:29.466211 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:38:29.466211 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: warnings.warn(msg) Jul 01 16:38:29.467449 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-2fbe5574-5384-4566-9a0d-9c4555091393 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:38:29.467881 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-2fbe5574-5384-4566-9a0d-9c4555091393 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:38:29.468666 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-2fbe5574-5384-4566-9a0d-9c4555091393 admin admin] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:38:29.469091 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: DEBUG oslo_concurrency.lockutils [None req-2fbe5574-5384-4566-9a0d-9c4555091393 admin admin] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:38:29.491064 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: INFO nova.api.openstack.requestlog [None req-2fbe5574-5384-4566-9a0d-9c4555091393 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.079876 Jul 01 16:38:29.491543 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: [pid: 109827|app: 0|req: 38/76] 10.222.0.57 () {60 vars in 1193 bytes} [Fri Jul 1 16:38:29 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:39:26.663950 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: Fri Jul 1 16:39:26 2022 - graceful shutdown triggered... Jul 01 16:39:26.664071 dv-cinder-797608-41-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 01 16:39:26.664880 dv-cinder-797608-41-iscsi devstack@n-api.service[109826]: Gracefully killing worker 1 (pid: 109826)... Jul 01 16:39:26.665244 dv-cinder-797608-41-iscsi devstack@n-api.service[109827]: Gracefully killing worker 2 (pid: 109827)... Jul 01 16:39:27.665191 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: worker 1 buried after 1 seconds Jul 01 16:39:27.665191 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: worker 2 buried after 1 seconds Jul 01 16:39:27.665191 dv-cinder-797608-41-iscsi devstack@n-api.service[109825]: goodbye to uWSGI. Jul 01 16:39:27.666824 dv-cinder-797608-41-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 01 16:39:27.667413 dv-cinder-797608-41-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 01 16:39:27.670325 dv-cinder-797608-41-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 01 16:39:27.683861 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 01 16:39:27.686555 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 1 16:39:27 2022] *** Jul 01 16:39:27.686765 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 01 16:39:27.686765 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 01 16:39:27.686765 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: nodename: dv-cinder-797608-41-iscsi Jul 01 16:39:27.686765 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: machine: x86_64 Jul 01 16:39:27.686765 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: clock source: unix Jul 01 16:39:27.686765 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: pcre jit disabled Jul 01 16:39:27.686765 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: detected number of CPU cores: 4 Jul 01 16:39:27.686765 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: current working directory: / Jul 01 16:39:27.686765 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: detected binary path: /usr/bin/uwsgi-core Jul 01 16:39:27.686765 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: your processes number limit is 47680 Jul 01 16:39:27.686765 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: your memory page size is 4096 bytes Jul 01 16:39:27.687607 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: detected max file descriptor number: 2048 Jul 01 16:39:27.687607 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: lock engine: pthread robust mutexes Jul 01 16:39:27.687607 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: thunder lock: enabled Jul 01 16:39:27.687607 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 01 16:39:27.687607 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 01 16:39:27.736229 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: Python main interpreter initialized at 0x56503734f9c0 Jul 01 16:39:27.736229 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: python threads support enabled Jul 01 16:39:27.736229 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: your server socket listen backlog is limited to 100 connections Jul 01 16:39:27.736229 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: your mercy for graceful operations on workers is 90 seconds Jul 01 16:39:27.736665 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: mapped 403077 bytes (393 KB) for 2 cores Jul 01 16:39:27.736665 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: *** Operational MODE: preforking *** Jul 01 16:39:27.736973 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: *** uWSGI is running in multiple interpreter mode *** Jul 01 16:39:27.736973 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: spawned uWSGI master process (pid: 124296) Jul 01 16:39:27.737186 dv-cinder-797608-41-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 01 16:39:27.737751 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: spawned uWSGI worker 1 (pid: 124316, cores: 1) Jul 01 16:39:27.738254 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: spawned uWSGI worker 2 (pid: 124317, cores: 1) Jul 01 16:39:27.738559 dv-cinder-797608-41-iscsi devstack@n-api.service[124296]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 01 16:39:28.425669 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 16:39:28.478950 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 16:39:29.671559 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 16:39:29.671559 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: from cryptography.utils import int_from_bytes Jul 01 16:39:29.672200 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 16:39:29.672200 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: from cryptography.utils import int_from_bytes Jul 01 16:39:29.759336 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 16:39:29.759336 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: from cryptography.utils import int_from_bytes Jul 01 16:39:29.759992 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 16:39:29.759992 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: from cryptography.utils import int_from_bytes Jul 01 16:39:32.083736 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 16:39:32.085226 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 16:39:32.085226 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 16:39:32.085226 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 16:39:32.085647 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 16:39:32.085747 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.086084 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.086422 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.086763 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.087105 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.087425 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.087759 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.088095 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.088428 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.088697 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.089023 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.089356 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-41-iscsi {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.089688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.090006 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.090551 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.090696 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.091004 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.091338 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.091652 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.092174 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.093750 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.093750 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.093750 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.093750 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.094113 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.094330 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.094573 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.094882 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.095221 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.095540 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.095961 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-41-iscsi {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.096289 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.096611 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.096949 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.097369 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.097689 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.098528 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.098879 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.099218 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.099550 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.099875 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.100259 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.100533 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.100864 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.101196 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.101505 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.101825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.102154 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.102493 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.102808 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.103337 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.103521 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.103743 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.104017 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.104358 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.104615 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.104869 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.105194 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.105527 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.105844 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.106159 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.106500 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.106820 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.107136 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.107453 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.107765 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.108083 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.108417 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.108742 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.109295 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.109466 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.109712 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.110120 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.110437 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.110709 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.111073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.111399 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.111725 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.112041 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.112369 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.112687 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.113003 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.113317 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.114207 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.114582 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.114897 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.115159 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.115468 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.115788 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.116112 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.116426 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.116740 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.117055 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.117363 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.117684 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.117991 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.118307 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.118649 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.119038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.119265 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.119579 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.119890 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.120200 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.120534 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.120861 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.121177 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.121494 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.121815 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.122125 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.122476 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.122789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.123102 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.123619 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.123940 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.124256 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.124583 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.124899 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.125216 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.125540 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.125851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.126167 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.126517 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.126834 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.127148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.127459 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.127823 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.128077 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.128440 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.128776 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.129001 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.130019 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.130268 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.130628 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.131049 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.131370 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.131693 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.132030 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.132374 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.132716 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.133065 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.133385 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.133724 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.134060 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.134414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.134729 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.135050 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.135381 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.135700 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.136069 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.136390 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.136714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.137039 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.137374 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.137696 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.138023 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.138360 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.138687 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.139011 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.139345 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.139675 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.139996 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.140350 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.140704 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.141025 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.141356 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.141703 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.142013 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.142326 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.142681 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.142999 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.143342 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.143661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.143986 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.144303 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.144622 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.145131 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.145624 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.145950 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.146311 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.146679 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.146986 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.147309 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.147635 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.147957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.148280 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.148597 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.148914 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.149229 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.149540 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.149858 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.150184 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.150553 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.150896 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.151209 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.151561 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.151877 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.152198 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.152524 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.152833 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.153149 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.153493 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.153783 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.154096 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.154454 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.154773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.155088 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.155420 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.155732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.156044 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.156372 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.156694 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.157016 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.157334 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.157654 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.157989 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.158414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.158686 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.159043 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.159373 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.159822 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.160162 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.160689 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.160943 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.161259 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.161584 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.161900 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.162221 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.162550 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.162864 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.163244 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.163481 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.163793 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.164096 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.164406 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.164735 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.165052 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.165366 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.165678 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.165989 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.166375 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.166696 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.167115 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.167388 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.167717 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.168049 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.168371 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.168697 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.169015 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.169335 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.169683 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.169962 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.170291 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.170638 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.170967 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.171284 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.171621 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.171940 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.172268 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.172627 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.173019 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.173248 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.173592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.173942 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.174242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.174601 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.174925 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.175244 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.175564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.175880 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.179389 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.179389 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.179389 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.179389 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.179389 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.179389 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.179389 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.179389 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.180700 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.180700 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.180700 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.180700 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.181418 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.181418 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.181418 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.182032 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.182032 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.182330 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.182631 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.182945 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.183266 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.183590 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.183907 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.184226 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.184541 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.184862 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.185178 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.185489 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.185799 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.186120 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.186473 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.186794 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.187124 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.187452 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.187762 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.188075 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.188403 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.188719 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.189031 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.189367 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.189702 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.189992 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.190310 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.190648 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.190814 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 16:39:32.191429 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.191582 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 16:39:32.191727 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.192037 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 16:39:32.192200 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.192372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 16:39:32.192520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.192673 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 16:39:32.192673 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.192956 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.192956 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.193252 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.193252 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.193754 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.193922 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.194078 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.194078 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.194512 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.194512 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.194796 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.194949 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.195102 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.195268 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.195423 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.195568 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.195711 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.195862 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.196006 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.196159 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.196302 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.196446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-41-iscsi {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.196598 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.196749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.196894 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.197052 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.197208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.197359 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.197505 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.197657 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.197810 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.197968 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.197968 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.198258 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.198450 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.198740 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.198740 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.199057 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.199246 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.199417 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.199821 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.199980 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.200232 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.200401 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.200555 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.200702 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.200847 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.201004 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.201004 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.201288 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.201535 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.201699 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.201854 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.202033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.202253 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.202418 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.202569 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.202726 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.202726 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.203010 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-41-iscsi {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.203164 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.203308 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.203462 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.203739 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.203958 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.204117 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.204263 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.204527 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.204680 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.204824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.204977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.205128 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.205273 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.205473 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.205632 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.205795 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.205941 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.206093 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.206238 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.206457 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.206621 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.206774 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.206928 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.207082 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.207818 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.207984 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.208444 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.208593 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.208791 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.209083 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.209243 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.209396 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.209550 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.209804 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.210312 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.210505 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.210699 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.210859 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.211013 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.211161 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.211327 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.211474 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.211743 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.211997 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.212164 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.212403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.212554 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.212710 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.212868 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.213025 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.213173 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.213318 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.213484 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.213643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.213643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.214130 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.214130 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.214130 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.214705 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.214872 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.215020 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.215165 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.215316 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.215462 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.215620 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.215776 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.215922 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.216065 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.216216 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.216368 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.216528 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.216681 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.216833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.216984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.216984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.217257 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.217417 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.217574 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.217725 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.217877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.218035 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.218190 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.218336 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.218545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.218690 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.218690 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.218981 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.218981 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.219280 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.219424 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.219593 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.219593 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.219998 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.220425 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.220581 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.220729 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.220880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.221032 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.221186 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.221345 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.221499 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.221651 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.221886 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.222056 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.222215 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.222384 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.222602 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.222750 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.222973 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.223279 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.223576 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.223738 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.223911 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.224173 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.224395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.224545 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.224730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.224970 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.225123 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.225267 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.225411 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.225567 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.225723 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.225870 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.226022 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.226185 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.226339 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.226526 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.226673 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.226836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.226983 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.227419 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.227575 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.227729 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.227875 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.228027 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.228172 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.228364 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.228510 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.228668 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.228822 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.228983 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.229127 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.229278 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.229430 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.229589 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.229743 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.229896 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.229896 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.229896 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.230681 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.230840 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.230987 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.231140 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.231305 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.231457 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.231616 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.231769 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.232017 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.232177 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.232337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.232483 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.232660 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.232880 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.233037 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.233197 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.233344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.233499 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.233499 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.233499 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.233918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.234194 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.234552 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.234708 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.234860 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.235012 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.235183 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.235426 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.235584 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.235730 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.235886 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.236030 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.236196 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.236358 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.236516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.236674 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.236838 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.236991 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.237154 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.237154 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.237443 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.237608 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.237788 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.238149 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.238322 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.238501 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.239192 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.239347 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.239507 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.239667 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.239832 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.239985 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.240162 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.240411 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.240788 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.240961 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.241202 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.241374 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.241527 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.241687 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.241839 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.242019 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.242252 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.242466 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.242636 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.242789 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.243034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.243203 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:39:32.243417 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.243571 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.243723 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.243881 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.244032 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.244032 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.244330 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.244654 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.244817 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.244968 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.245133 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.245294 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.245462 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.245723 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.245883 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.246034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.246200 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.246380 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.246380 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.246675 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.246675 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.246962 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.247126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.247285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.247445 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.247615 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.247775 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.247935 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.248099 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.248250 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.248401 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.248551 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.248702 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.248861 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.249014 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.249165 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.249322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.249481 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.249651 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.249817 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.249972 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.250123 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.250273 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.250594 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.250961 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.251126 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.251279 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.251431 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.251582 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.251733 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.251884 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.252061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.252240 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.252476 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.252641 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.252801 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.252968 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.253205 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.253362 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.253521 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.253689 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.253849 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.254020 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.254217 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.254448 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.254640 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.254954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.255173 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.255367 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.255528 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.255706 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.255955 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.256121 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.256121 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.256430 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.256583 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.256751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.256903 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.257054 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.257214 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.257376 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.257534 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.257686 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.257843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.258002 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.258163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.258315 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.258490 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.258654 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.258817 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.258977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.259138 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.259290 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.259443 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.259601 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.259753 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.259918 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.260071 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.260230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.260389 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.260560 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.261003 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.261188 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.261188 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.261482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.261633 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.261791 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.261943 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.262103 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.262103 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.262449 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.262694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.263590 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.263777 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.263939 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.264099 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.264263 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.264424 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.264808 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.265145 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.265307 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.265468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.265632 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.265795 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.265975 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.266249 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.266440 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.266606 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.266771 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.266933 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.267094 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.267247 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.267399 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.267560 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.267714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.267866 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.268026 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.268185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.268356 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.268561 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.268723 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.268877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.269028 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.269187 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.269348 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.269510 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.269670 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.270437 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.270678 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.271205 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.271637 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.271896 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.272058 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.272259 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.272413 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.272573 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.272849 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.273019 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.273173 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.273332 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.273512 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.273760 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.273932 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.274088 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.274259 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.274468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.274634 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.274825 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.274997 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.275357 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.275522 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.275675 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.275826 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.275978 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.276140 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.276410 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.276817 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.276992 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.277155 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.277326 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.277505 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.277661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.277822 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.278498 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.278592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.278733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.278811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.278892 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.278965 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.279064 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.279151 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.279246 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.279332 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.279416 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.279509 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.279601 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.279686 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.279783 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.279883 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.279969 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.280060 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.280060 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.280222 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.280307 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.280391 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.280481 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.280566 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.280649 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.280740 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.280826 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.280908 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.280994 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.281066 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.281144 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.281231 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.281312 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.281385 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.281461 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.281533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.281609 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.281701 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.281786 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.281876 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.281961 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.282051 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.282144 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.282230 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.282313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.282500 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.282590 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.282674 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.282820 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.282915 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.283000 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.283082 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.283171 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.283262 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.283355 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.283439 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.283532 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.283617 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.283700 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.283785 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.283866 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.283951 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.284032 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.284114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.284196 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.284278 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.284372 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.284457 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.284541 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.284631 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.284714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.284809 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.284893 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.284983 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.285065 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.285154 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.285238 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.285329 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.285329 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.285600 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.285758 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.285855 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.285939 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.286034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.286127 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.286219 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.286311 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.286417 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.286491 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.286575 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.286650 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.286727 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.286799 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.286875 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.286959 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.287044 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.287135 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.287219 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.287302 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.287391 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.287489 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.287574 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.287665 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.287763 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.287855 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.287947 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.288044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.288128 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.288211 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.288300 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.288300 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.288470 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.288556 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.288638 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.288720 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.288802 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.288883 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.288976 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.289067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.289158 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.289250 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.289335 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.289441 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.289527 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.289611 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.289700 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.289839 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.289961 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.290084 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.290204 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.290321 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.290471 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.290573 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.290667 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.290764 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.290849 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.290942 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.290942 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.291094 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.291166 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.291245 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.291329 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.291408 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.291480 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.291550 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.291632 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.291737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.291923 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.292068 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.292246 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.292400 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.292566 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.292713 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.292890 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.293021 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.293339 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.293439 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.293658 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.293758 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.293973 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.294076 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.294284 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.294407 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.294624 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.294717 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.294978 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.295078 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.295293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.295400 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.295602 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.295699 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.295930 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.296021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.296256 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.296357 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.296573 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.296664 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.296891 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.296985 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.297201 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.297302 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.297512 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.297603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.297837 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.297928 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.298149 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.298254 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.298484 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.298581 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.298802 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.298906 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.299119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.299338 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.299431 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.299695 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.299787 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.300019 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.300122 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.300349 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.300447 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.300665 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.300793 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.300979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.301683 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.301837 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.301992 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.302174 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.302529 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.302846 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.303171 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.303253 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.303491 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.303574 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.303805 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.304117 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.304204 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.304437 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.304519 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.304755 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.304847 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.305065 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.305147 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.305382 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.305465 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.305695 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.305776 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.307182 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.307359 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.307463 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.307558 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.307662 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.307755 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.307849 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.307942 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.308024 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.308111 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.308191 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.308263 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.308263 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.308390 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.308472 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.308617 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.308707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.308936 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.309019 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.309251 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.309335 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.309570 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.309661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.309882 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.309964 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.310191 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.310328 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.310528 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.310630 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.310846 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.310951 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.311157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.311249 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.311479 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.311580 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.311789 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.311882 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.312106 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.312249 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.312413 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.312515 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.312737 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.312843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.313048 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.313147 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.313361 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.313454 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.313670 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.313783 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.313979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.314079 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.314327 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.314479 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.314658 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.314900 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.314996 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.315243 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.315339 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.315570 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.315673 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.315913 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.316051 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.316237 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.316339 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.316554 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.316657 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.316923 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.317070 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.317278 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.317485 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.317612 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.317846 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.317947 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.318169 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.318269 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.318527 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.318631 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.318842 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.318936 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.319161 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.319254 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.319478 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.319583 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.319792 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.319885 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.320109 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.320200 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.320415 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.320518 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.320730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.320850 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.321039 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.321159 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.321354 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.321455 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.321665 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.321756 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.321969 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.322068 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.322275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.322468 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.322619 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.322745 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.322930 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.323023 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.323236 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.323329 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.323549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.323641 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.323856 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.323950 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.324174 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.324268 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.324480 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.324580 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.324786 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.324880 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.325090 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.325184 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.325401 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.325496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.325714 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.325819 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.326018 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.326148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.326371 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.326581 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.326684 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.326906 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.327007 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.327236 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.327339 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.327567 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.327660 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.327882 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.327982 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.328190 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.328291 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.328502 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.328594 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.328826 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.328927 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.329144 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.329242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.329451 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.329552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.329761 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.329854 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.330068 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.330169 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.330402 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.330519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.330700 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.330794 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.331009 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.331103 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.331315 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.331415 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.331620 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.331721 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.333083 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.333449 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.333551 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.333646 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.333646 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.333825 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.333906 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.333990 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.334086 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.334365 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.334466 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.334685 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.334780 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.334997 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.335099 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.335304 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.335404 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.335615 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.335716 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.335931 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.336140 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.336264 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.336383 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.336541 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.336634 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.336850 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.336950 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.337161 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.337289 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.337471 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.337571 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.337779 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.337872 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.338092 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.338187 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.338434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.338544 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.338747 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.338842 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.339057 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.339158 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.339369 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.339470 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.339679 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.339773 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.339994 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.340094 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.340321 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.340418 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.340639 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.340733 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.340957 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.341050 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.341282 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.341386 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.341605 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.341696 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.341958 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.342212 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.342306 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.342552 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.342655 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.342867 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.342962 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.343185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.343332 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.343496 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.343590 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.343838 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.343940 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.344152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.344244 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.344467 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.344561 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.344784 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.344903 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.345100 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.345205 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.345416 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.345508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.345730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.345829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.346039 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.346141 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.346373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.346516 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.346684 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.346789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.346997 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.347111 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.347324 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.347465 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.347647 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.347747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.348060 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.348704 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.348913 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.349118 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.349237 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.349556 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.349663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.349884 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.350205 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.350360 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.350553 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.350651 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.350881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.351058 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.351203 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.351381 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.351538 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.351700 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.351872 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.352014 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.352192 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.352336 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.352533 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.352640 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.352866 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.352967 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.353221 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.353316 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.353542 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.353644 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.353892 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.353985 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.354226 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.354319 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.354576 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.354679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.354897 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.354988 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.355205 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.355297 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.355451 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 16:39:32.355544 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.355817 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.356146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.356456 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.356765 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.357110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.357438 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.357747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.358072 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.358517 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.358833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.359142 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.359560 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.359874 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.360187 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.360512 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.360834 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.361161 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.361468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.361783 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.362094 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.362444 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.362772 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.363086 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.363405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.363797 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.364355 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.364688 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.365009 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.365337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.365759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.366088 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.366429 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.366764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.367096 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.367408 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.367717 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.368031 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.368343 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.368657 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.368981 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.369291 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.369607 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.369921 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.370233 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.370564 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.370875 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.371200 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.371509 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.371833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.372148 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.372473 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.372798 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.373107 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.373432 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.373745 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.374071 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.374403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.374715 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.375063 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.375371 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.375695 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.376028 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.376357 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.376671 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.377006 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.377335 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.377656 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.377978 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.378304 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.378637 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.378942 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.379287 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.379835 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.380159 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.380473 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.380787 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.381094 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.381403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.381712 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.382043 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.382383 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.382696 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.383012 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.383320 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.383629 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.383931 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.384279 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.384589 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.384924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.385241 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.385563 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.385894 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.386206 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.386560 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.386883 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.387201 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.387520 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.387836 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.388152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.388468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.388785 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.389095 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.389414 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.389730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.390081 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.390675 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.391014 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.391337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.391659 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.391976 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.392296 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.392618 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.392935 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.393252 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.393568 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.393884 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.394218 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.394570 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.395441 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.396023 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.396356 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.396681 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.397008 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.397329 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.397693 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.398018 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.398333 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.398675 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.398995 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.399315 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.399632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.400199 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.400313 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.400575 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.400890 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.401203 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.401519 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.401831 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.402161 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.402594 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.402922 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.403242 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.403559 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.403878 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.404405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.404729 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.405068 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.405401 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.405730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.406050 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.406393 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.406731 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.407095 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.407405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.407720 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.408034 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.408342 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.408669 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.409267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.409588 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.409912 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.410230 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.411173 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.411600 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.411930 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.412268 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.412605 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.412929 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.413245 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.413567 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.413880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.414191 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.414536 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.414856 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.415173 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.415552 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.415914 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.416265 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.416583 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.416900 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.417224 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.417558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.417869 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.418180 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.418513 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.418836 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.419148 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.419459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.419770 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.420079 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.420393 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.420702 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.421015 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.421324 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.421639 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.421947 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.422259 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.422637 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.422814 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO dbcounter [None req-77f55c44-86fd-4754-bb07-d4d82f5b9ee8 None None] Registered counter for database nova_api Jul 01 16:39:32.422970 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.423280 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.423587 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.423910 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.424223 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.424548 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.424865 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.425183 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.425536 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.426714 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.427341 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.427706 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.428056 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.428415 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.428768 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.429095 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.429420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.429743 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.430091 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.430444 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.430772 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.431103 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.431497 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.431862 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.431862 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.432371 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.432692 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.433011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.433329 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.433650 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.433968 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.434287 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.434735 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.435168 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.435502 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.435831 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.436158 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.436486 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.436806 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.437125 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.437442 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.437758 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.438084 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.438448 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.439384 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.439384 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.439639 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.439922 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.440334 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.440575 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.440901 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.441228 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.441558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.442467 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.442806 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.443129 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.443464 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.443812 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.444149 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.444481 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.444606 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_db.sqlalchemy.engines [None req-77f55c44-86fd-4754-bb07-d4d82f5b9ee8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 16:39:32.444811 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.445099 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.445409 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.445724 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.446049 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.446386 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.446698 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.447009 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.447338 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.447637 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.447948 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.448257 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.448566 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.448881 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.449188 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.449498 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.449806 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.450121 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.450455 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.450766 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.451082 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.451389 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.451546 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writer thread running {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 16:39:32.451707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.451993 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.452304 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.452614 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.452949 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.453289 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.453608 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.453934 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.454256 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.454609 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.454922 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.455246 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.455573 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.455896 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.456207 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.456543 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.456857 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.457173 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.457520 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.457834 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.458147 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.458736 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.459073 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.459408 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.459718 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.460054 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.460377 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.460701 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.461021 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.461339 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.461674 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.461989 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.462303 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.462651 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.462969 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.463285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.463607 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.463926 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.464258 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.464635 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.464897 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.465225 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.465554 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.465908 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.466225 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.466600 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.466935 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.467254 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.467572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.467880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:39:32.468127 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 16:39:32.509537 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.context [None req-77f55c44-86fd-4754-bb07-d4d82f5b9ee8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d4cbc3c-94ee-4f68-9082-34d85fef2b77(cell1) {{(pid=124316) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 16:39:32.513313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-77f55c44-86fd-4754-bb07-d4d82f5b9ee8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:39:32.514993 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-77f55c44-86fd-4754-bb07-d4d82f5b9ee8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:39:32.516921 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-77f55c44-86fd-4754-bb07-d4d82f5b9ee8 None None] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:39:32.517837 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-77f55c44-86fd-4754-bb07-d4d82f5b9ee8 None None] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:39:32.519979 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO dbcounter [None req-77f55c44-86fd-4754-bb07-d4d82f5b9ee8 None None] Registered counter for database nova_cell0 Jul 01 16:39:32.524247 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO dbcounter [None req-77f55c44-86fd-4754-bb07-d4d82f5b9ee8 None None] Registered counter for database nova_cell1 Jul 01 16:39:32.533270 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_db.sqlalchemy.engines [None req-77f55c44-86fd-4754-bb07-d4d82f5b9ee8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 16:39:32.533594 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO dbcounter [None req-8dba2576-2c04-4411-9c77-1c3e66054479 None None] Registered counter for database nova_api Jul 01 16:39:32.533880 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_db.sqlalchemy.engines [None req-77f55c44-86fd-4754-bb07-d4d82f5b9ee8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 16:39:32.540146 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writer thread running {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 16:39:32.542293 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writer thread running {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 16:39:32.553410 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_db.sqlalchemy.engines [None req-8dba2576-2c04-4411-9c77-1c3e66054479 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124317) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 16:39:32.559955 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writer thread running {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 16:39:32.617039 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.context [None req-8dba2576-2c04-4411-9c77-1c3e66054479 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d4cbc3c-94ee-4f68-9082-34d85fef2b77(cell1) {{(pid=124317) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 16:39:32.621090 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8dba2576-2c04-4411-9c77-1c3e66054479 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:39:32.622679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8dba2576-2c04-4411-9c77-1c3e66054479 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:39:32.623477 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8dba2576-2c04-4411-9c77-1c3e66054479 None None] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:39:32.625434 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8dba2576-2c04-4411-9c77-1c3e66054479 None None] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:39:32.627513 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO dbcounter [None req-8dba2576-2c04-4411-9c77-1c3e66054479 None None] Registered counter for database nova_cell0 Jul 01 16:39:32.631622 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO dbcounter [None req-8dba2576-2c04-4411-9c77-1c3e66054479 None None] Registered counter for database nova_cell1 Jul 01 16:39:32.639075 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_db.sqlalchemy.engines [None req-8dba2576-2c04-4411-9c77-1c3e66054479 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124317) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 16:39:32.641354 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_db.sqlalchemy.engines [None req-8dba2576-2c04-4411-9c77-1c3e66054479 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124317) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 16:39:32.646511 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writer thread running {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 16:39:32.654230 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writer thread running {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 16:39:32.692540 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO dbcounter [None req-77f55c44-86fd-4754-bb07-d4d82f5b9ee8 None None] Registered counter for database nova_cell0 Jul 01 16:39:32.699669 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_db.sqlalchemy.engines [None req-77f55c44-86fd-4754-bb07-d4d82f5b9ee8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 16:39:32.704095 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writer thread running {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 16:39:32.803369 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO dbcounter [None req-8dba2576-2c04-4411-9c77-1c3e66054479 None None] Registered counter for database nova_cell0 Jul 01 16:39:32.812022 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_db.sqlalchemy.engines [None req-8dba2576-2c04-4411-9c77-1c3e66054479 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124317) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 16:39:32.816620 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writer thread running {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 16:39:33.064037 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: WARNING keystonemiddleware.auth_token [None req-77f55c44-86fd-4754-bb07-d4d82f5b9ee8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 16:39:33.073897 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: WARNING keystonemiddleware.auth_token [None req-77f55c44-86fd-4754-bb07-d4d82f5b9ee8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 16:39:33.153977 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: WARNING keystonemiddleware.auth_token [None req-8dba2576-2c04-4411-9c77-1c3e66054479 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 16:39:33.161436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: WARNING keystonemiddleware.auth_token [None req-8dba2576-2c04-4411-9c77-1c3e66054479 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 16:39:33.457868 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: WARNING keystonemiddleware.auth_token [None req-77f55c44-86fd-4754-bb07-d4d82f5b9ee8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 16:39:33.464259 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: WARNING keystonemiddleware.auth_token [None req-77f55c44-86fd-4754-bb07-d4d82f5b9ee8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 16:39:33.472194 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56503734f9c0 pid: 124316 (default app) Jul 01 16:39:33.515131 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: WARNING keystonemiddleware.auth_token [None req-8dba2576-2c04-4411-9c77-1c3e66054479 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 16:39:33.521241 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: WARNING keystonemiddleware.auth_token [None req-8dba2576-2c04-4411-9c77-1c3e66054479 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 16:39:33.526619 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56503734f9c0 pid: 124317 (default app) Jul 01 16:40:15.414759 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:15.415579 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:15.416831 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:15.417783 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:16.842901 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cf110ec7-a97b-476c-b56b-953545d14bfc tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Action: 'create', calling method: .version_select at 0x7fa86dbfe3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1316059955"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:40:18.761197 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-cf110ec7-a97b-476c-b56b-953545d14bfc tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.359523 Jul 01 16:40:18.763218 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 1/1] 10.222.0.57 () {60 vars in 1154 bytes} [Fri Jul 1 16:40:15 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3364 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 01 16:40:19.323358 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-22e7e683-4eab-4508-a115-a55848027abb tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Calling method '.version_select at 0x7fa86dcadf70>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:19.376262 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=3 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:19.380090 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=3 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:19.383055 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=3 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:19.383610 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=3 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:20.590225 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-22e7e683-4eab-4508-a115-a55848027abb tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e75afa47-d2be-4de1-9707-66dcb82aa7ce" status: 200 len: 346 microversion: 2.1 time: 1.815753 Jul 01 16:40:20.591480 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 1/2] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 1 16:40:18 2022] GET /compute/v2.1/os-volumes/e75afa47-d2be-4de1-9707-66dcb82aa7ce => generated 346 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:40:20.603724 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1205374c-ef3b-42dd-bd55-52078920bbb5 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Action: 'create', calling method: .version_select at 0x7fa86dad21f0>, body: {"snapshot": {"volume_id": "e75afa47-d2be-4de1-9707-66dcb82aa7ce", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1324089724"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:40:21.351410 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1205374c-ef3b-42dd-bd55-52078920bbb5 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.752017 Jul 01 16:40:21.357685 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 2/3] 10.222.0.57 () {60 vars in 1161 bytes} [Fri Jul 1 16:40:20 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:40:21.369869 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ef9efff0-0226-430c-81d0-580a344adb71 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Calling method '.version_select at 0x7fa86dabf3a0>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:21.533301 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ef9efff0-0226-430c-81d0-580a344adb71 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/f49afdfc-e6fa-40b9-b2db-8f759f384ed1" status: 200 len: 287 microversion: 2.1 time: 0.168545 Jul 01 16:40:21.534189 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1250 bytes} [Fri Jul 1 16:40:21 2022] GET /compute/v2.1/os-snapshots/f49afdfc-e6fa-40b9-b2db-8f759f384ed1 => generated 287 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:40:21.545897 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-157df259-c3ed-4389-aaa3-bc83ee1d304d tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Calling method '.version_select at 0x7fa86dad28b0>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:21.619892 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-157df259-c3ed-4389-aaa3-bc83ee1d304d tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.079733 Jul 01 16:40:21.625742 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 3/5] 10.222.0.57 () {58 vars in 1139 bytes} [Fri Jul 1 16:40:21 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:40:21.631025 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3b431fc7-bfed-4722-a7b4-2158d19ddd17 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Calling method '.version_select at 0x7fa86dabf430>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:21.688322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3b431fc7-bfed-4722-a7b4-2158d19ddd17 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/f49afdfc-e6fa-40b9-b2db-8f759f384ed1" status: 200 len: 287 microversion: 2.1 time: 0.061329 Jul 01 16:40:21.688894 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 3/6] 10.222.0.57 () {58 vars in 1250 bytes} [Fri Jul 1 16:40:21 2022] GET /compute/v2.1/os-snapshots/f49afdfc-e6fa-40b9-b2db-8f759f384ed1 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:40:22.703193 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e05ef918-337d-4aad-a083-c553452e8de0 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Calling method '.version_select at 0x7fa86dabfb80>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:22.760856 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e3bf832d-4abd-4c60-84de-d19af602b220 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Action: 'create', calling method: .version_select at 0x7fa86dad2ee0>, body: {"keypair": {"name": "tempest-keypair-981105985", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzKpDVXyfOGBieMfcV7PdV2BLf7T2KArVIHjhHnIOWiJ+RHUiWWMfbKsww8IGJE070FI67va+RTNbC3u/dVrwA7W/50Wb0fuNJhRbQKBlytDsPKpQbaxj2/Cc3OejEbOQ=="}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:40:22.771380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e05ef918-337d-4aad-a083-c553452e8de0 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/f49afdfc-e6fa-40b9-b2db-8f759f384ed1" status: 200 len: 287 microversion: 2.1 time: 0.073699 Jul 01 16:40:22.772389 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1250 bytes} [Fri Jul 1 16:40:22 2022] GET /compute/v2.1/os-snapshots/f49afdfc-e6fa-40b9-b2db-8f759f384ed1 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:40:22.831289 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-e3bf832d-4abd-4c60-84de-d19af602b220 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Getting quotas for project 5747a83d930f4075a78e9b14abd58c7f. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:40:22.843151 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-e3bf832d-4abd-4c60-84de-d19af602b220 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Getting quotas for user 7c4da21fbfa3472cac6e766a2f4799d8 and project 5747a83d930f4075a78e9b14abd58c7f. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:40:22.959442 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e3bf832d-4abd-4c60-84de-d19af602b220 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.384758 Jul 01 16:40:22.965590 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 4/8] 10.222.0.57 () {60 vars in 1158 bytes} [Fri Jul 1 16:40:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:40:23.782504 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-886853ab-64c0-492e-8c24-884c4571c765 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Calling method '.version_select at 0x7fa86dad3280>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:23.868201 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-886853ab-64c0-492e-8c24-884c4571c765 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/f49afdfc-e6fa-40b9-b2db-8f759f384ed1" status: 200 len: 287 microversion: 2.1 time: 0.089370 Jul 01 16:40:23.868882 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 5/9] 10.222.0.57 () {58 vars in 1250 bytes} [Fri Jul 1 16:40:23 2022] GET /compute/v2.1/os-snapshots/f49afdfc-e6fa-40b9-b2db-8f759f384ed1 => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:40:24.881030 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d07e5fd9-59dd-46be-95e1-96e16a18224e tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Calling method '.version_select at 0x7fa86da42700>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:24.939039 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d07e5fd9-59dd-46be-95e1-96e16a18224e tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/f49afdfc-e6fa-40b9-b2db-8f759f384ed1" status: 200 len: 288 microversion: 2.1 time: 0.062600 Jul 01 16:40:24.939602 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 5/10] 10.222.0.57 () {58 vars in 1250 bytes} [Fri Jul 1 16:40:24 2022] GET /compute/v2.1/os-snapshots/f49afdfc-e6fa-40b9-b2db-8f759f384ed1 => generated 288 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:40:24.949646 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-fcae082e-0c7d-4de9-bc94-ce7917b8d285 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Calling method '.version_select at 0x7fa86dabfd30>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:25.104343 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-fcae082e-0c7d-4de9-bc94-ce7917b8d285 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/f49afdfc-e6fa-40b9-b2db-8f759f384ed1" status: 202 len: 0 microversion: 2.1 time: 0.158272 Jul 01 16:40:25.106380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 6/11] 10.222.0.57 () {58 vars in 1253 bytes} [Fri Jul 1 16:40:24 2022] DELETE /compute/v2.1/os-snapshots/f49afdfc-e6fa-40b9-b2db-8f759f384ed1 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:40:25.114680 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-890475c6-2848-4599-aa32-1e47b3a45791 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Calling method '.version_select at 0x7fa86da42dc0>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:25.179474 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-890475c6-2848-4599-aa32-1e47b3a45791 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/f49afdfc-e6fa-40b9-b2db-8f759f384ed1" status: 200 len: 287 microversion: 2.1 time: 0.068980 Jul 01 16:40:25.180292 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 6/12] 10.222.0.57 () {58 vars in 1250 bytes} [Fri Jul 1 16:40:25 2022] GET /compute/v2.1/os-snapshots/f49afdfc-e6fa-40b9-b2db-8f759f384ed1 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:40:26.191183 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-218a05c1-8543-44fc-adb8-9e95f4db6cf5 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Calling method '.version_select at 0x7fa86dabf160>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:26.256011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-218a05c1-8543-44fc-adb8-9e95f4db6cf5 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] HTTP exception thrown: Snapshot f49afdfc-e6fa-40b9-b2db-8f759f384ed1 could not be found. Jul 01 16:40:26.260446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-218a05c1-8543-44fc-adb8-9e95f4db6cf5 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Request method failure captured: Jul 01 16:40:26.260446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/os-snapshots/f49afdfc-e6fa-40b9-b2db-8f759f384ed1 HTTP/1.1 Jul 01 16:40:26.260446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:40:26.260446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:40:26.260446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:40:26.260446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:40:26.260446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:40:26.260446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:40:26.260446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:40:26.260446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:40:26.260446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyNvchMjsC4tQiOCxUUD7AuuBATCMD_TZeUyimHYCKnxWiU1UZwqQyaw161FzFNoqrZvkDToy8Urz-ofcPcYnis_WIK9mVCedB0dgDb2E94ZKNy_On1AL01BWK5LPBY8mlfpTaUUsCS05uy_00RcBXdpLOKHdKpYtcI-SF8WpKuTIX0 Jul 01 16:40:26.260446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:40:26.260446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:40:26.260446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:40:26.260446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:40:26.260446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:40:26.260446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:40:26.260446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: eec1d42b049c4f8080d138d248280cac Jul 01 16:40:26.260446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1151703438 Jul 01 16:40:26.260446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:40:26.260446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:40:26.261631 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eec1d42b049c4f8080d138d248280cac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eec1d42b049c4f8080d138d248280cac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_eec1d42b049c4f8080d138d248280cac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/eec1d42b049c4f8080d138d248280cac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:40:26.261631 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1151703438 Jul 01 16:40:26.261631 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: eec1d42b049c4f8080d138d248280cac Jul 01 16:40:26.261631 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1151703438 Jul 01 16:40:26.261631 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-VolumesSnapshotsTestJSON-1151703438-project Jul 01 16:40:26.261631 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:40:26.261631 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:40:26.261631 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: aca6b4b731ed4347827748e05fb284ea Jul 01 16:40:26.261631 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1151703438-project Jul 01 16:40:26.261631 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: Jul 01 16:40:26.261631 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Snapshot f49afdfc-e6fa-40b9-b2db-8f759f384ed1 could not be found. Jul 01 16:40:26.261631 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': 'f49afdfc-e6fa-40b9-b2db-8f759f384ed1'} Jul 01 16:40:26.261631 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:40:26.262572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:40:26.262572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 01 16:40:26.262572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 01 16:40:26.262572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 01 16:40:26.262572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 01 16:40:26.262572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 01 16:40:26.262572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 01 16:40:26.262572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 16:40:26.262572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 16:40:26.262572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 16:40:26.262572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 16:40:26.262572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 16:40:26.262572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 16:40:26.262572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 16:40:26.262572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 16:40:26.262572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f49afdfc-e6fa-40b9-b2db-8f759f384ed1 could not be found. (HTTP 404) (Request-ID: req-590754a7-cc04-4945-8245-0ab6ea558c94) Jul 01 16:40:26.262572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:40:26.262572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:40:26.263522 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:40:26.263522 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:40:26.263522 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 01 16:40:26.263522 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 01 16:40:26.263522 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 16:40:26.263522 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 16:40:26.263522 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 01 16:40:26.263522 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 01 16:40:26.263522 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 16:40:26.263522 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 16:40:26.263522 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 01 16:40:26.263522 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 01 16:40:26.263522 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 01 16:40:26.263522 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 01 16:40:26.263522 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 01 16:40:26.263522 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 01 16:40:26.263522 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 16:40:26.263522 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 16:40:26.263522 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 16:40:26.264482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 16:40:26.264482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 16:40:26.264482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 16:40:26.264482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 16:40:26.264482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 16:40:26.264482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f49afdfc-e6fa-40b9-b2db-8f759f384ed1 could not be found. Jul 01 16:40:26.264482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:40:26.264482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:40:26.264482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:40:26.264482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:40:26.264482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:40:26.264482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:40:26.264482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:40:26.264482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:40:26.264482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 16:40:26.264482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 16:40:26.264482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:40:26.264482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:40:26.264482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 01 16:40:26.264482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:40:26.265560 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f49afdfc-e6fa-40b9-b2db-8f759f384ed1 could not be found. Jul 01 16:40:26.265560 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:40:26.265560 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:40:26.265560 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:40:26.265560 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:40:26.265560 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:40:26.265560 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:40:26.265560 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:40:26.265560 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:40:26.265560 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f49afdfc-e6fa-40b9-b2db-8f759f384ed1 could not be found. Jul 01 16:40:26.265560 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:40:26.265560 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-218a05c1-8543-44fc-adb8-9e95f4db6cf5 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Returning 404 to user: Snapshot f49afdfc-e6fa-40b9-b2db-8f759f384ed1 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:40:26.265560 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-218a05c1-8543-44fc-adb8-9e95f4db6cf5 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/f49afdfc-e6fa-40b9-b2db-8f759f384ed1" status: 404 len: 111 microversion: 2.1 time: 0.074798 Jul 01 16:40:26.271727 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8f24a2df-d0ce-4ce0-923a-44cb2e954c77 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Calling method '.version_select at 0x7fa86da654c0>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:26.282431 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 7/13] 10.222.0.57 () {58 vars in 1250 bytes} [Fri Jul 1 16:40:26 2022] GET /compute/v2.1/os-snapshots/f49afdfc-e6fa-40b9-b2db-8f759f384ed1 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:40:26.740142 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8f24a2df-d0ce-4ce0-923a-44cb2e954c77 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/e75afa47-d2be-4de1-9707-66dcb82aa7ce" status: 202 len: 0 microversion: 2.1 time: 0.473294 Jul 01 16:40:26.741607 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 7/14] 10.222.0.57 () {58 vars in 1247 bytes} [Fri Jul 1 16:40:26 2022] DELETE /compute/v2.1/os-volumes/e75afa47-d2be-4de1-9707-66dcb82aa7ce => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 16:40:26.750966 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ac923381-f0d8-4ff0-a623-84c0ae135e4f tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Calling method '.version_select at 0x7fa86dad3c10>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:26.932609 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ac923381-f0d8-4ff0-a623-84c0ae135e4f tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e75afa47-d2be-4de1-9707-66dcb82aa7ce" status: 200 len: 345 microversion: 2.1 time: 0.186676 Jul 01 16:40:26.933810 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 8/15] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 1 16:40:26 2022] GET /compute/v2.1/os-volumes/e75afa47-d2be-4de1-9707-66dcb82aa7ce => generated 345 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:40:27.945284 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9a878178-d56f-4d29-bbc4-8bf16d817a46 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Calling method '.version_select at 0x7fa86da42f70>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:28.007213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-9a878178-d56f-4d29-bbc4-8bf16d817a46 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] HTTP exception thrown: Volume e75afa47-d2be-4de1-9707-66dcb82aa7ce could not be found. Jul 01 16:40:28.007213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9a878178-d56f-4d29-bbc4-8bf16d817a46 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Request method failure captured: Jul 01 16:40:28.007213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/os-volumes/e75afa47-d2be-4de1-9707-66dcb82aa7ce HTTP/1.1 Jul 01 16:40:28.007213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:40:28.007213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:40:28.007213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:40:28.007213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:40:28.007213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:40:28.007213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:40:28.007213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:40:28.007213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:40:28.007213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyNvchMjsC4tQiOCxUUD7AuuBATCMD_TZeUyimHYCKnxWiU1UZwqQyaw161FzFNoqrZvkDToy8Urz-ofcPcYnis_WIK9mVCedB0dgDb2E94ZKNy_On1AL01BWK5LPBY8mlfpTaUUsCS05uy_00RcBXdpLOKHdKpYtcI-SF8WpKuTIX0 Jul 01 16:40:28.007213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:40:28.007213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:40:28.007213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:40:28.007213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:40:28.007213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:40:28.007213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:40:28.007213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: eec1d42b049c4f8080d138d248280cac Jul 01 16:40:28.007213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1151703438 Jul 01 16:40:28.007213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:40:28.007213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:40:28.008305 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eec1d42b049c4f8080d138d248280cac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eec1d42b049c4f8080d138d248280cac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_eec1d42b049c4f8080d138d248280cac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/eec1d42b049c4f8080d138d248280cac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:40:28.008305 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1151703438 Jul 01 16:40:28.008305 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: eec1d42b049c4f8080d138d248280cac Jul 01 16:40:28.008305 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1151703438 Jul 01 16:40:28.008305 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-VolumesSnapshotsTestJSON-1151703438-project Jul 01 16:40:28.008305 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:40:28.008305 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:40:28.008305 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: aca6b4b731ed4347827748e05fb284ea Jul 01 16:40:28.008305 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1151703438-project Jul 01 16:40:28.008305 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: Jul 01 16:40:28.008305 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Volume e75afa47-d2be-4de1-9707-66dcb82aa7ce could not be found. Jul 01 16:40:28.008305 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'id': 'e75afa47-d2be-4de1-9707-66dcb82aa7ce'} Jul 01 16:40:28.008305 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:40:28.008938 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:40:28.008938 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 16:40:28.008938 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 16:40:28.008938 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 16:40:28.008938 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 16:40:28.008938 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 16:40:28.008938 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 16:40:28.008938 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 16:40:28.008938 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 16:40:28.008938 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 16:40:28.008938 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 16:40:28.008938 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 16:40:28.008938 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 16:40:28.008938 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 16:40:28.008938 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 16:40:28.008938 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e75afa47-d2be-4de1-9707-66dcb82aa7ce could not be found. (HTTP 404) (Request-ID: req-33be4b49-d85f-4845-819a-8f5bd297b10e) Jul 01 16:40:28.008938 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:40:28.008938 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:40:28.008938 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:40:28.009829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:40:28.009829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 16:40:28.009829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 16:40:28.009829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 16:40:28.009829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 16:40:28.009829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 16:40:28.009829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 16:40:28.009829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 16:40:28.009829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 16:40:28.009829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 16:40:28.009829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 16:40:28.009829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 16:40:28.009829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 16:40:28.009829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 16:40:28.009829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 16:40:28.009829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 16:40:28.009829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 16:40:28.009829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 16:40:28.009829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 16:40:28.010953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 16:40:28.010953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 16:40:28.010953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 16:40:28.010953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 16:40:28.010953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e75afa47-d2be-4de1-9707-66dcb82aa7ce could not be found. Jul 01 16:40:28.010953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:40:28.010953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:40:28.010953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:40:28.010953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:40:28.010953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:40:28.010953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:40:28.010953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:40:28.010953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:40:28.010953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 16:40:28.010953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 16:40:28.010953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:40:28.010953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:40:28.010953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 16:40:28.010953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:40:28.013661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e75afa47-d2be-4de1-9707-66dcb82aa7ce could not be found. Jul 01 16:40:28.013661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:40:28.013661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:40:28.013661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:40:28.013661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:40:28.013661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:40:28.013661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:40:28.013661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:40:28.013661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:40:28.013661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e75afa47-d2be-4de1-9707-66dcb82aa7ce could not be found. Jul 01 16:40:28.013661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:40:28.013661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9a878178-d56f-4d29-bbc4-8bf16d817a46 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Returning 404 to user: Volume e75afa47-d2be-4de1-9707-66dcb82aa7ce could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:40:28.013661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9a878178-d56f-4d29-bbc4-8bf16d817a46 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e75afa47-d2be-4de1-9707-66dcb82aa7ce" status: 404 len: 109 microversion: 2.1 time: 0.067562 Jul 01 16:40:28.013661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 8/16] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 1 16:40:27 2022] GET /compute/v2.1/os-volumes/e75afa47-d2be-4de1-9707-66dcb82aa7ce => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:40:28.029218 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-32d25a09-7263-4cfb-bbe3-0f2da633cc50 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Calling method '.version_select at 0x7fa86da2f310>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:28.077813 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-32d25a09-7263-4cfb-bbe3-0f2da633cc50 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] HTTP exception thrown: Volume e75afa47-d2be-4de1-9707-66dcb82aa7ce could not be found. Jul 01 16:40:28.082293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-32d25a09-7263-4cfb-bbe3-0f2da633cc50 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Request method failure captured: Jul 01 16:40:28.082293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: DELETE /compute/v2.1/os-volumes/e75afa47-d2be-4de1-9707-66dcb82aa7ce HTTP/1.1 Jul 01 16:40:28.082293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:40:28.082293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:40:28.082293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:40:28.082293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:40:28.082293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:40:28.082293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:40:28.082293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:40:28.082293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:40:28.082293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyNvchMjsC4tQiOCxUUD7AuuBATCMD_TZeUyimHYCKnxWiU1UZwqQyaw161FzFNoqrZvkDToy8Urz-ofcPcYnis_WIK9mVCedB0dgDb2E94ZKNy_On1AL01BWK5LPBY8mlfpTaUUsCS05uy_00RcBXdpLOKHdKpYtcI-SF8WpKuTIX0 Jul 01 16:40:28.082293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:40:28.082293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:40:28.082293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:40:28.082293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:40:28.082293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:40:28.082293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:40:28.082293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: eec1d42b049c4f8080d138d248280cac Jul 01 16:40:28.082293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1151703438 Jul 01 16:40:28.082293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:40:28.082293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:40:28.084693 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eec1d42b049c4f8080d138d248280cac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eec1d42b049c4f8080d138d248280cac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_eec1d42b049c4f8080d138d248280cac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/eec1d42b049c4f8080d138d248280cac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:40:28.084693 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1151703438 Jul 01 16:40:28.084693 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: eec1d42b049c4f8080d138d248280cac Jul 01 16:40:28.084693 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1151703438 Jul 01 16:40:28.084693 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-VolumesSnapshotsTestJSON-1151703438-project Jul 01 16:40:28.084693 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:40:28.084693 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:40:28.084693 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: aca6b4b731ed4347827748e05fb284ea Jul 01 16:40:28.084693 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1151703438-project Jul 01 16:40:28.084693 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: Jul 01 16:40:28.084693 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Volume e75afa47-d2be-4de1-9707-66dcb82aa7ce could not be found. Jul 01 16:40:28.084693 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': 'e75afa47-d2be-4de1-9707-66dcb82aa7ce'} Jul 01 16:40:28.084693 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:40:28.085719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:40:28.085719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 16:40:28.085719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 16:40:28.085719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 16:40:28.085719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 16:40:28.085719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 16:40:28.085719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 16:40:28.085719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 16:40:28.085719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 16:40:28.085719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 16:40:28.085719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 16:40:28.085719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 16:40:28.085719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 16:40:28.085719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 16:40:28.085719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 16:40:28.085719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e75afa47-d2be-4de1-9707-66dcb82aa7ce could not be found. (HTTP 404) (Request-ID: req-546a1c90-420e-43f9-8cfd-83f707dfcec7) Jul 01 16:40:28.085719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:40:28.085719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:40:28.085719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:40:28.087379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:40:28.087379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 01 16:40:28.087379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 01 16:40:28.087379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 16:40:28.087379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 16:40:28.087379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 16:40:28.087379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 16:40:28.087379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 16:40:28.087379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 16:40:28.087379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 16:40:28.087379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 16:40:28.087379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 16:40:28.087379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 16:40:28.087379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 16:40:28.087379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 16:40:28.087379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 16:40:28.087379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 16:40:28.087379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 16:40:28.087379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 16:40:28.088694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 16:40:28.088694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 16:40:28.088694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 16:40:28.088694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 16:40:28.088694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e75afa47-d2be-4de1-9707-66dcb82aa7ce could not be found. Jul 01 16:40:28.088694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:40:28.088694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:40:28.088694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:40:28.088694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:40:28.088694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:40:28.088694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:40:28.088694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:40:28.088694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:40:28.088694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 16:40:28.088694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 16:40:28.088694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:40:28.088694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:40:28.088694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 01 16:40:28.088694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:40:28.089891 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e75afa47-d2be-4de1-9707-66dcb82aa7ce could not be found. Jul 01 16:40:28.089891 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:40:28.089891 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:40:28.089891 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:40:28.089891 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:40:28.089891 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:40:28.089891 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:40:28.089891 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:40:28.089891 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:40:28.089891 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e75afa47-d2be-4de1-9707-66dcb82aa7ce could not be found. Jul 01 16:40:28.089891 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:40:28.089891 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-32d25a09-7263-4cfb-bbe3-0f2da633cc50 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Returning 404 to user: Volume e75afa47-d2be-4de1-9707-66dcb82aa7ce could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:40:28.091625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-32d25a09-7263-4cfb-bbe3-0f2da633cc50 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/e75afa47-d2be-4de1-9707-66dcb82aa7ce" status: 404 len: 109 microversion: 2.1 time: 0.065531 Jul 01 16:40:28.092538 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 9/17] 10.222.0.57 () {58 vars in 1247 bytes} [Fri Jul 1 16:40:28 2022] DELETE /compute/v2.1/os-volumes/e75afa47-d2be-4de1-9707-66dcb82aa7ce => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 16:40:28.101979 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fc215480-beee-43d9-b6c3-2fea19df2aa8 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Calling method '.version_select at 0x7fa86e4aa820>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:28.170294 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-fc215480-beee-43d9-b6c3-2fea19df2aa8 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] HTTP exception thrown: Volume e75afa47-d2be-4de1-9707-66dcb82aa7ce could not be found. Jul 01 16:40:28.173285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fc215480-beee-43d9-b6c3-2fea19df2aa8 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Request method failure captured: Jul 01 16:40:28.173285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/os-volumes/e75afa47-d2be-4de1-9707-66dcb82aa7ce HTTP/1.1 Jul 01 16:40:28.173285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:40:28.173285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:40:28.173285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:40:28.173285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:40:28.173285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:40:28.173285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:40:28.173285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:40:28.173285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:40:28.173285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyNvchMjsC4tQiOCxUUD7AuuBATCMD_TZeUyimHYCKnxWiU1UZwqQyaw161FzFNoqrZvkDToy8Urz-ofcPcYnis_WIK9mVCedB0dgDb2E94ZKNy_On1AL01BWK5LPBY8mlfpTaUUsCS05uy_00RcBXdpLOKHdKpYtcI-SF8WpKuTIX0 Jul 01 16:40:28.173285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:40:28.173285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:40:28.173285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:40:28.173285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:40:28.173285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:40:28.173285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:40:28.173285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: eec1d42b049c4f8080d138d248280cac Jul 01 16:40:28.173285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1151703438 Jul 01 16:40:28.173285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:40:28.173285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:40:28.174611 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eec1d42b049c4f8080d138d248280cac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eec1d42b049c4f8080d138d248280cac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_eec1d42b049c4f8080d138d248280cac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/eec1d42b049c4f8080d138d248280cac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:40:28.174611 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1151703438 Jul 01 16:40:28.174611 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: eec1d42b049c4f8080d138d248280cac Jul 01 16:40:28.174611 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1151703438 Jul 01 16:40:28.174611 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-VolumesSnapshotsTestJSON-1151703438-project Jul 01 16:40:28.174611 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:40:28.174611 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:40:28.174611 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: aca6b4b731ed4347827748e05fb284ea Jul 01 16:40:28.174611 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1151703438-project Jul 01 16:40:28.174611 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: Jul 01 16:40:28.174611 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Volume e75afa47-d2be-4de1-9707-66dcb82aa7ce could not be found. Jul 01 16:40:28.174611 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'id': 'e75afa47-d2be-4de1-9707-66dcb82aa7ce'} Jul 01 16:40:28.174611 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:40:28.176080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:40:28.176080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 16:40:28.176080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 16:40:28.176080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 16:40:28.176080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 16:40:28.176080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 16:40:28.176080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 16:40:28.176080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 16:40:28.176080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 16:40:28.176080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 16:40:28.176080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 16:40:28.176080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 16:40:28.176080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 16:40:28.176080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 16:40:28.176080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 16:40:28.176080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e75afa47-d2be-4de1-9707-66dcb82aa7ce could not be found. (HTTP 404) (Request-ID: req-127ec0ba-b867-4f41-b4de-0ce05b179fbd) Jul 01 16:40:28.176080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:40:28.176080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:40:28.176080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:40:28.177851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:40:28.177851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 16:40:28.177851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 16:40:28.177851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 16:40:28.177851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 16:40:28.177851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 16:40:28.177851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 16:40:28.177851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 16:40:28.177851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 16:40:28.177851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 16:40:28.177851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 16:40:28.177851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 16:40:28.177851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 16:40:28.177851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 16:40:28.177851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 16:40:28.177851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 16:40:28.177851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 16:40:28.177851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 16:40:28.177851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 16:40:28.179063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 16:40:28.179063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 16:40:28.179063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 16:40:28.179063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 16:40:28.179063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e75afa47-d2be-4de1-9707-66dcb82aa7ce could not be found. Jul 01 16:40:28.179063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:40:28.179063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:40:28.179063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:40:28.179063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:40:28.179063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:40:28.179063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:40:28.179063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:40:28.179063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:40:28.179063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 16:40:28.179063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 16:40:28.179063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:40:28.179063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:40:28.179063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 16:40:28.179063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:40:28.179984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e75afa47-d2be-4de1-9707-66dcb82aa7ce could not be found. Jul 01 16:40:28.179984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:40:28.179984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:40:28.179984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:40:28.179984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:40:28.179984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:40:28.179984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:40:28.179984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:40:28.179984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:40:28.179984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e75afa47-d2be-4de1-9707-66dcb82aa7ce could not be found. Jul 01 16:40:28.179984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:40:28.179984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fc215480-beee-43d9-b6c3-2fea19df2aa8 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] Returning 404 to user: Volume e75afa47-d2be-4de1-9707-66dcb82aa7ce could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:40:28.179984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fc215480-beee-43d9-b6c3-2fea19df2aa8 tempest-VolumesSnapshotsTestJSON-1151703438 tempest-VolumesSnapshotsTestJSON-1151703438-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e75afa47-d2be-4de1-9707-66dcb82aa7ce" status: 404 len: 109 microversion: 2.1 time: 0.080216 Jul 01 16:40:28.184462 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 9/18] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 1 16:40:28 2022] GET /compute/v2.1/os-volumes/e75afa47-d2be-4de1-9707-66dcb82aa7ce => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:40:30.404100 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d3acf7f8-7842-4cd3-8613-e4bcdc476996 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1547419421", "imageRef": "42a4b1a9-dea6-4c87-a2c1-328b9c0c8558", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c5acd85f-f778-4915-8079-a3e9582e6528"}], "security_groups": [{"name": "tempest-securitygroup--1403010320"}], "key_name": "tempest-keypair-981105985", "user_data": "}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:40:31.102827 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.network.neutron [None req-d3acf7f8-7842-4cd3-8613-e4bcdc476996 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] validate_networks() for [('c5acd85f-f778-4915-8079-a3e9582e6528', None, None, None, None, None)] {{(pid=124317) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 16:40:33.649046 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-d3acf7f8-7842-4cd3-8613-e4bcdc476996 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Flavor limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 16:40:33.649636 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-d3acf7f8-7842-4cd3-8613-e4bcdc476996 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Image limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 16:40:33.649916 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-d3acf7f8-7842-4cd3-8613-e4bcdc476996 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Flavor pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 16:40:33.650320 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-d3acf7f8-7842-4cd3-8613-e4bcdc476996 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Image pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 16:40:33.650751 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-d3acf7f8-7842-4cd3-8613-e4bcdc476996 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 16:40:33.709489 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d3acf7f8-7842-4cd3-8613-e4bcdc476996 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:33.709933 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d3acf7f8-7842-4cd3-8613-e4bcdc476996 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:33.710765 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d3acf7f8-7842-4cd3-8613-e4bcdc476996 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:33.711284 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d3acf7f8-7842-4cd3-8613-e4bcdc476996 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:33.870893 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-d3acf7f8-7842-4cd3-8613-e4bcdc476996 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Getting quotas for project 5747a83d930f4075a78e9b14abd58c7f. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:40:33.886761 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-d3acf7f8-7842-4cd3-8613-e4bcdc476996 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Getting quotas for user 7c4da21fbfa3472cac6e766a2f4799d8 and project 5747a83d930f4075a78e9b14abd58c7f. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:40:33.914258 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d3acf7f8-7842-4cd3-8613-e4bcdc476996 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Going to run 1 instances... {{(pid=124317) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 16:40:33.921137 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d3acf7f8-7842-4cd3-8613-e4bcdc476996 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42a4b1a9-dea6-4c87-a2c1-328b9c0c8558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124317) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 16:40:34.210645 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d3acf7f8-7842-4cd3-8613-e4bcdc476996 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.815924 Jul 01 16:40:34.212010 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 10/19] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 1 16:40:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 3819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 16:40:34.220246 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=4 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:34.220989 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:34.226944 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3d0a25ac-245e-44a8-9ac8-d6fc11a9f97d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:34.228492 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3d0a25ac-245e-44a8-9ac8-d6fc11a9f97d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:34.444416 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3d0a25ac-245e-44a8-9ac8-d6fc11a9f97d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:34.481246 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3d0a25ac-245e-44a8-9ac8-d6fc11a9f97d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1241 microversion: 2.1 time: 0.262438 Jul 01 16:40:34.489686 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 10/20] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:34 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1241 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:35.506019 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-12c9e1e4-eb91-47d1-85f8-3e1a597b95a5 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:35.508979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-12c9e1e4-eb91-47d1-85f8-3e1a597b95a5 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:35.973209 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-12c9e1e4-eb91-47d1-85f8-3e1a597b95a5 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:35.991387 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-12c9e1e4-eb91-47d1-85f8-3e1a597b95a5 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1241 microversion: 2.1 time: 0.494594 Jul 01 16:40:35.992723 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 11/21] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:35 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1241 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:36.962003 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-988dff85-3ab2-468e-b231-a90719b758f0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Action: 'create', calling method: .version_select at 0x7fa86d1d1e50>, body: {"keypair": {"name": "tempest-keypair-739661522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTMrqzQgHkrwDBJeT8714h5I1bE0wioT/lxyHqe//efIgRgS1c9ta3X9lBtk+rotDTXRz5bOYJW1ZD9UDVnEz9vvJ6gfarVP0BXcZGOrRJt2q2NhuO4wj1fk2RBjAuNIw=="}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:40:37.012442 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-08f3f75c-8778-48ac-be49-3426e65d0748 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:37.014028 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-08f3f75c-8778-48ac-be49-3426e65d0748 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:37.023183 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-988dff85-3ab2-468e-b231-a90719b758f0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Getting quotas for project 315dd9cfab134d008039e1229e42a96e. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:40:37.039662 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-988dff85-3ab2-468e-b231-a90719b758f0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Getting quotas for user e471b31763074167ba81c2c25f39b857 and project 315dd9cfab134d008039e1229e42a96e. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:40:37.051466 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-08f3f75c-8778-48ac-be49-3426e65d0748 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:37.052253 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-08f3f75c-8778-48ac-be49-3426e65d0748 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:37.055136 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-08f3f75c-8778-48ac-be49-3426e65d0748 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:37.055763 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-08f3f75c-8778-48ac-be49-3426e65d0748 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:37.151094 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-988dff85-3ab2-468e-b231-a90719b758f0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.757973 Jul 01 16:40:37.153700 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 11/22] 10.222.0.57 () {62 vars in 1199 bytes} [Fri Jul 1 16:40:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 761 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 01 16:40:37.617284 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-08f3f75c-8778-48ac-be49-3426e65d0748 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:37.642594 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-08f3f75c-8778-48ac-be49-3426e65d0748 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1245 microversion: 2.1 time: 0.633471 Jul 01 16:40:37.656176 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 12/23] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:37 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1245 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:38.664072 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-01330705-0857-4887-b779-0ee38d0aad01 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:38.665500 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-01330705-0857-4887-b779-0ee38d0aad01 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:38.701901 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-01330705-0857-4887-b779-0ee38d0aad01 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:38.706168 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-01330705-0857-4887-b779-0ee38d0aad01 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:38.709429 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-01330705-0857-4887-b779-0ee38d0aad01 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:38.710941 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-01330705-0857-4887-b779-0ee38d0aad01 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:39.262130 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-01330705-0857-4887-b779-0ee38d0aad01 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:39.291506 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-01330705-0857-4887-b779-0ee38d0aad01 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1299 microversion: 2.1 time: 0.635940 Jul 01 16:40:39.301717 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 12/24] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:38 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1299 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:39.453219 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f303be60-61fe-4f32-90f1-bdc22a57ff92 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-40437882", "imageRef": "42a4b1a9-dea6-4c87-a2c1-328b9c0c8558", "flavorRef": "452", "networks": [{"uuid": "9c45ed7a-934f-4bce-930b-7b9d61ad046e"}]}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:40:39.612641 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.network.neutron [None req-f303be60-61fe-4f32-90f1-bdc22a57ff92 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] validate_networks() for [('9c45ed7a-934f-4bce-930b-7b9d61ad046e', None, None, None, None, None)] {{(pid=124317) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 16:40:40.309147 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-20723d15-8cec-44f6-bde9-c59866c74685 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:40.309912 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-20723d15-8cec-44f6-bde9-c59866c74685 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:40.318841 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-20723d15-8cec-44f6-bde9-c59866c74685 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:40.319914 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-20723d15-8cec-44f6-bde9-c59866c74685 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:40.321023 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-20723d15-8cec-44f6-bde9-c59866c74685 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:40.323727 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-20723d15-8cec-44f6-bde9-c59866c74685 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:40.572726 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-20723d15-8cec-44f6-bde9-c59866c74685 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:40.586939 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-20723d15-8cec-44f6-bde9-c59866c74685 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1299 microversion: 2.1 time: 0.281537 Jul 01 16:40:40.590569 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 13/25] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:40 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1299 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:40:42.220200 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3e0b00b5-84a0-4f51-869a-8f8c086924bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1537765492", "imageRef": "42a4b1a9-dea6-4c87-a2c1-328b9c0c8558", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:40:42.374000 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-f303be60-61fe-4f32-90f1-bdc22a57ff92 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Flavor limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 16:40:42.375287 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-f303be60-61fe-4f32-90f1-bdc22a57ff92 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Image limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 16:40:42.375990 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-f303be60-61fe-4f32-90f1-bdc22a57ff92 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Flavor pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 16:40:42.376640 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-f303be60-61fe-4f32-90f1-bdc22a57ff92 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Image pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 16:40:42.377274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-f303be60-61fe-4f32-90f1-bdc22a57ff92 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 16:40:42.396961 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f303be60-61fe-4f32-90f1-bdc22a57ff92 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:42.397704 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f303be60-61fe-4f32-90f1-bdc22a57ff92 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:42.403127 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f303be60-61fe-4f32-90f1-bdc22a57ff92 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:42.404121 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f303be60-61fe-4f32-90f1-bdc22a57ff92 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:42.489952 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-f303be60-61fe-4f32-90f1-bdc22a57ff92 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Getting quotas for project 2c49e143df7c4d059430b7dc5bffd475. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:40:42.507305 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-f303be60-61fe-4f32-90f1-bdc22a57ff92 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Getting quotas for user ea27a708e2c84ccc905ae783524bd12f and project 2c49e143df7c4d059430b7dc5bffd475. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:40:42.550751 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f303be60-61fe-4f32-90f1-bdc22a57ff92 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Going to run 1 instances... {{(pid=124317) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 16:40:42.567365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f303be60-61fe-4f32-90f1-bdc22a57ff92 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42a4b1a9-dea6-4c87-a2c1-328b9c0c8558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124317) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 16:40:42.575340 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-3e0b00b5-84a0-4f51-869a-8f8c086924bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] validate_networks() for [('40bcc3f6-35b7-411b-aab1-54f20941aafb', None, None, None, None, None)] {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 16:40:42.742937 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f303be60-61fe-4f32-90f1-bdc22a57ff92 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.066903 Jul 01 16:40:42.746071 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 13/26] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 1 16:40:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 4071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 16:40:42.762411 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-669c9594-bdd9-4d20-bd74-f70530a1d98e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:42.771375 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-669c9594-bdd9-4d20-bd74-f70530a1d98e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:42.790182 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-669c9594-bdd9-4d20-bd74-f70530a1d98e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:42.790766 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-669c9594-bdd9-4d20-bd74-f70530a1d98e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:42.800008 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-669c9594-bdd9-4d20-bd74-f70530a1d98e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:42.804026 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-669c9594-bdd9-4d20-bd74-f70530a1d98e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:43.239132 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-669c9594-bdd9-4d20-bd74-f70530a1d98e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:43.259922 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-669c9594-bdd9-4d20-bd74-f70530a1d98e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1299 microversion: 2.1 time: 0.501893 Jul 01 16:40:43.266902 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 14/27] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:42 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1299 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:43.275412 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-99ad3503-3b27-4e59-9b9d-0ebf49b61236 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:43.277271 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-99ad3503-3b27-4e59-9b9d-0ebf49b61236 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:44.100118 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-99ad3503-3b27-4e59-9b9d-0ebf49b61236 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:44.115663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-99ad3503-3b27-4e59-9b9d-0ebf49b61236 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1213 microversion: 2.1 time: 0.847337 Jul 01 16:40:44.120782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 15/28] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:43 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1213 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:44.280549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e4af311d-c86c-4a8f-90b3-261a4a7167bf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:44.281811 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e4af311d-c86c-4a8f-90b3-261a4a7167bf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:44.298647 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e4af311d-c86c-4a8f-90b3-261a4a7167bf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:44.299417 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e4af311d-c86c-4a8f-90b3-261a4a7167bf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:44.310762 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e4af311d-c86c-4a8f-90b3-261a4a7167bf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:44.311942 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e4af311d-c86c-4a8f-90b3-261a4a7167bf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:44.865530 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e4af311d-c86c-4a8f-90b3-261a4a7167bf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:44.894120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e4af311d-c86c-4a8f-90b3-261a4a7167bf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1367 microversion: 2.1 time: 0.602502 Jul 01 16:40:44.914952 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 16/29] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:44 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1367 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:45.137972 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8ea8b7e2-2301-4978-9699-900b48147d4b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:45.138655 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8ea8b7e2-2301-4978-9699-900b48147d4b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:45.159263 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8ea8b7e2-2301-4978-9699-900b48147d4b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:45.162881 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8ea8b7e2-2301-4978-9699-900b48147d4b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:45.164107 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8ea8b7e2-2301-4978-9699-900b48147d4b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:45.167516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8ea8b7e2-2301-4978-9699-900b48147d4b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:45.627206 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8ea8b7e2-2301-4978-9699-900b48147d4b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:45.636359 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8ea8b7e2-2301-4978-9699-900b48147d4b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1217 microversion: 2.1 time: 0.503083 Jul 01 16:40:45.636979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 17/30] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:45 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1217 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:40:45.912431 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2f9112d0-8e81-4b7b-8925-c2258c676b91 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:45.913440 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2f9112d0-8e81-4b7b-8925-c2258c676b91 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:45.940891 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2f9112d0-8e81-4b7b-8925-c2258c676b91 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:45.945895 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2f9112d0-8e81-4b7b-8925-c2258c676b91 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:45.947218 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2f9112d0-8e81-4b7b-8925-c2258c676b91 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:45.947910 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2f9112d0-8e81-4b7b-8925-c2258c676b91 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:47.027588 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2f9112d0-8e81-4b7b-8925-c2258c676b91 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:47.037465 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2f9112d0-8e81-4b7b-8925-c2258c676b91 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1367 microversion: 2.1 time: 1.129938 Jul 01 16:40:47.038114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 18/31] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:45 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1367 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:40:47.082535 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8edfe2f5-88d3-4ed5-988f-bc3d58b51932 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1928144992", "imageRef": "42a4b1a9-dea6-4c87-a2c1-328b9c0c8558", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "122e1655-ca16-42e2-ac40-3aa0137062fe"}], "security_groups": [{"name": "tempest-securitygroup--359971006"}], "key_name": "tempest-keypair-739661522", "user_data": "}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:40:47.094337 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=6 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:47.733987 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.network.neutron [None req-8edfe2f5-88d3-4ed5-988f-bc3d58b51932 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] validate_networks() for [('122e1655-ca16-42e2-ac40-3aa0137062fe', None, None, None, None, None)] {{(pid=124317) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 16:40:47.822985 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-3e0b00b5-84a0-4f51-869a-8f8c086924bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 16:40:47.823421 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-3e0b00b5-84a0-4f51-869a-8f8c086924bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 16:40:47.824595 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-3e0b00b5-84a0-4f51-869a-8f8c086924bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 16:40:47.824595 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-3e0b00b5-84a0-4f51-869a-8f8c086924bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 16:40:47.824805 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-3e0b00b5-84a0-4f51-869a-8f8c086924bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 16:40:47.855186 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3e0b00b5-84a0-4f51-869a-8f8c086924bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:47.858254 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3e0b00b5-84a0-4f51-869a-8f8c086924bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:47.864340 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3e0b00b5-84a0-4f51-869a-8f8c086924bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:47.865141 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3e0b00b5-84a0-4f51-869a-8f8c086924bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:47.936956 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-3e0b00b5-84a0-4f51-869a-8f8c086924bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Getting quotas for project bf55d220c94d4445af9f73c532029e42. Resources: {'ram', 'cores', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:40:47.943633 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-3e0b00b5-84a0-4f51-869a-8f8c086924bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Getting quotas for user 71c383c04f9543d8ab97a6c0db268ca5 and project bf55d220c94d4445af9f73c532029e42. Resources: {'ram', 'cores', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:40:47.967138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3e0b00b5-84a0-4f51-869a-8f8c086924bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 16:40:47.972598 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3e0b00b5-84a0-4f51-869a-8f8c086924bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42a4b1a9-dea6-4c87-a2c1-328b9c0c8558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 16:40:48.210688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3e0b00b5-84a0-4f51-869a-8f8c086924bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.045992 Jul 01 16:40:48.216971 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 14/32] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 1 16:40:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 7048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 16:40:48.228953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a1cf48a0-6c02-4483-9c31-62943e1b4442 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:48.229227 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a1cf48a0-6c02-4483-9c31-62943e1b4442 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:48.286940 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a1cf48a0-6c02-4483-9c31-62943e1b4442 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:48.295731 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a1cf48a0-6c02-4483-9c31-62943e1b4442 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:48.298535 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a1cf48a0-6c02-4483-9c31-62943e1b4442 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:48.300472 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a1cf48a0-6c02-4483-9c31-62943e1b4442 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:48.856285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a1cf48a0-6c02-4483-9c31-62943e1b4442 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:48.865623 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a1cf48a0-6c02-4483-9c31-62943e1b4442 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1271 microversion: 2.1 time: 0.652427 Jul 01 16:40:48.884192 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 15/33] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:48 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1271 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:48.935754 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4f1f5fba-436d-492e-b31a-218318948491 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:48.937301 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4f1f5fba-436d-492e-b31a-218318948491 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:49.000930 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4f1f5fba-436d-492e-b31a-218318948491 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:49.012754 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4f1f5fba-436d-492e-b31a-218318948491 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:49.020770 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4f1f5fba-436d-492e-b31a-218318948491 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:49.022368 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4f1f5fba-436d-492e-b31a-218318948491 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:50.177378 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4f1f5fba-436d-492e-b31a-218318948491 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:50.185418 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4f1f5fba-436d-492e-b31a-218318948491 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1367 microversion: 2.1 time: 1.299777 Jul 01 16:40:50.186052 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 16/34] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:48 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1367 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:50.207944 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9d09e999-c0bc-4f5e-9e0f-37dfefcda8e1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:50.208828 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9d09e999-c0bc-4f5e-9e0f-37dfefcda8e1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:50.224206 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9d09e999-c0bc-4f5e-9e0f-37dfefcda8e1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:50.230681 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9d09e999-c0bc-4f5e-9e0f-37dfefcda8e1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:50.231769 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9d09e999-c0bc-4f5e-9e0f-37dfefcda8e1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:50.234302 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9d09e999-c0bc-4f5e-9e0f-37dfefcda8e1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:50.405976 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-8edfe2f5-88d3-4ed5-988f-bc3d58b51932 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Flavor limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 16:40:50.406596 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-8edfe2f5-88d3-4ed5-988f-bc3d58b51932 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Image limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 16:40:50.406909 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-8edfe2f5-88d3-4ed5-988f-bc3d58b51932 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Flavor pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 16:40:50.407306 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-8edfe2f5-88d3-4ed5-988f-bc3d58b51932 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Image pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 16:40:50.407904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-8edfe2f5-88d3-4ed5-988f-bc3d58b51932 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 16:40:50.412103 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9d09e999-c0bc-4f5e-9e0f-37dfefcda8e1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:50.429331 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9d09e999-c0bc-4f5e-9e0f-37dfefcda8e1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1226 microversion: 2.1 time: 0.241539 Jul 01 16:40:50.431705 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 17/35] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:50 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1226 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:50.432283 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8edfe2f5-88d3-4ed5-988f-bc3d58b51932 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:50.432823 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8edfe2f5-88d3-4ed5-988f-bc3d58b51932 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:50.433628 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8edfe2f5-88d3-4ed5-988f-bc3d58b51932 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:50.434211 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8edfe2f5-88d3-4ed5-988f-bc3d58b51932 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:50.438287 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fa4b1f41-8c74-4445-9066-ef2038d8a3b4 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:50.439319 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-fa4b1f41-8c74-4445-9066-ef2038d8a3b4 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:50.484573 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fa4b1f41-8c74-4445-9066-ef2038d8a3b4 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:50.488673 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fa4b1f41-8c74-4445-9066-ef2038d8a3b4 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:50.490563 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fa4b1f41-8c74-4445-9066-ef2038d8a3b4 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:50.490720 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-8edfe2f5-88d3-4ed5-988f-bc3d58b51932 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Getting quotas for project 315dd9cfab134d008039e1229e42a96e. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:40:50.495162 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fa4b1f41-8c74-4445-9066-ef2038d8a3b4 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:50.500049 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-8edfe2f5-88d3-4ed5-988f-bc3d58b51932 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Getting quotas for user e471b31763074167ba81c2c25f39b857 and project 315dd9cfab134d008039e1229e42a96e. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:40:50.525642 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8edfe2f5-88d3-4ed5-988f-bc3d58b51932 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Going to run 1 instances... {{(pid=124317) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 16:40:50.531901 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8edfe2f5-88d3-4ed5-988f-bc3d58b51932 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42a4b1a9-dea6-4c87-a2c1-328b9c0c8558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124317) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 16:40:50.674037 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8edfe2f5-88d3-4ed5-988f-bc3d58b51932 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.610332 Jul 01 16:40:50.681535 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 19/36] 10.222.0.57 () {62 vars in 1187 bytes} [Fri Jul 1 16:40:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 3643 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 01 16:40:50.695029 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fa4b1f41-8c74-4445-9066-ef2038d8a3b4 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:50.708455 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1f571b44-6be2-4467-b808-c184930840ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-798774322", "imageRef": "42a4b1a9-dea6-4c87-a2c1-328b9c0c8558", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:40:50.713345 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fa4b1f41-8c74-4445-9066-ef2038d8a3b4 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1271 microversion: 2.1 time: 0.279641 Jul 01 16:40:50.717890 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 18/37] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:50 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1271 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:50.735026 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c4198d27-8cf5-44f9-aab5-f886a16dbf97 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:50.736371 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c4198d27-8cf5-44f9-aab5-f886a16dbf97 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:50.875430 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.network.neutron [None req-1f571b44-6be2-4467-b808-c184930840ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] validate_networks() for [('40bcc3f6-35b7-411b-aab1-54f20941aafb', None, None, None, None, None)] {{(pid=124317) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 16:40:51.043954 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c4198d27-8cf5-44f9-aab5-f886a16dbf97 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:51.056717 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c4198d27-8cf5-44f9-aab5-f886a16dbf97 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:51.058295 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c4198d27-8cf5-44f9-aab5-f886a16dbf97 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:51.062102 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c4198d27-8cf5-44f9-aab5-f886a16dbf97 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1281 microversion: 2.20 time: 0.342364 Jul 01 16:40:51.063978 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 19/38] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:40:50 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1281 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:40:51.171078 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-c4586e66-7f4b-4336-be1b-9d55040c615e req-8a56fd8e-6a1f-4e8b-b177-2b6c8afef553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdb792a6-440e-4a96-89d8-3b65ee1a5a2e", "tag": "0d85f90c-e016-4950-ba0b-5986f1ed198f"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:40:51.197685 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-c4586e66-7f4b-4336-be1b-9d55040c615e req-8a56fd8e-6a1f-4e8b-b177-2b6c8afef553 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:51.198324 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-c4586e66-7f4b-4336-be1b-9d55040c615e req-8a56fd8e-6a1f-4e8b-b177-2b6c8afef553 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:51.268862 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-c4586e66-7f4b-4336-be1b-9d55040c615e req-8a56fd8e-6a1f-4e8b-b177-2b6c8afef553 service nova] Creating event network-changed:0d85f90c-e016-4950-ba0b-5986f1ed198f for instance bdb792a6-440e-4a96-89d8-3b65ee1a5a2e on hv-cinder-79760 Jul 01 16:40:51.269299 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-c4586e66-7f4b-4336-be1b-9d55040c615e req-8a56fd8e-6a1f-4e8b-b177-2b6c8afef553 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124316) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 16:40:51.273783 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fc6d56b8-a35c-4153-8a1d-c59d405d09c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:51.274383 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fc6d56b8-a35c-4153-8a1d-c59d405d09c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:51.275275 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fc6d56b8-a35c-4153-8a1d-c59d405d09c2 None None] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:51.275721 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fc6d56b8-a35c-4153-8a1d-c59d405d09c2 None None] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:51.303944 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.compute.rpcapi [None req-fc6d56b8-a35c-4153-8a1d-c59d405d09c2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 01 16:40:51.305755 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fc6d56b8-a35c-4153-8a1d-c59d405d09c2 None None] Releasing lock "compute-rpcapi-router" {{(pid=124316) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 16:40:51.370734 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fc6d56b8-a35c-4153-8a1d-c59d405d09c2 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.304920 Jul 01 16:40:51.371669 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 20/39] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:40:51.377985 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2e7d12e2-8d67-420e-ab26-4eb2e6393e7c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:51.382299 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2e7d12e2-8d67-420e-ab26-4eb2e6393e7c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:51.410191 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2e7d12e2-8d67-420e-ab26-4eb2e6393e7c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:51.411657 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2e7d12e2-8d67-420e-ab26-4eb2e6393e7c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:51.412767 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2e7d12e2-8d67-420e-ab26-4eb2e6393e7c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:51.413667 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2e7d12e2-8d67-420e-ab26-4eb2e6393e7c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:51.973732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2e7d12e2-8d67-420e-ab26-4eb2e6393e7c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:52.022272 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2e7d12e2-8d67-420e-ab26-4eb2e6393e7c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1367 microversion: 2.1 time: 0.649227 Jul 01 16:40:52.022899 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 21/40] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:51 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1367 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:52.056375 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e65993c7-1a6e-480c-922e-692198d40ca7 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:52.057968 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e65993c7-1a6e-480c-922e-692198d40ca7 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:52.080172 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e65993c7-1a6e-480c-922e-692198d40ca7 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:52.080990 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e65993c7-1a6e-480c-922e-692198d40ca7 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:52.083236 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e65993c7-1a6e-480c-922e-692198d40ca7 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:52.084874 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e65993c7-1a6e-480c-922e-692198d40ca7 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:52.232552 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-1f571b44-6be2-4467-b808-c184930840ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Flavor limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 16:40:52.233112 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-1f571b44-6be2-4467-b808-c184930840ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Image limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 16:40:52.234169 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-1f571b44-6be2-4467-b808-c184930840ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Flavor pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 16:40:52.234717 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-1f571b44-6be2-4467-b808-c184930840ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Image pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 16:40:52.235226 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-1f571b44-6be2-4467-b808-c184930840ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 16:40:52.259071 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1f571b44-6be2-4467-b808-c184930840ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:52.259615 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1f571b44-6be2-4467-b808-c184930840ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:52.260596 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1f571b44-6be2-4467-b808-c184930840ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:52.261060 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1f571b44-6be2-4467-b808-c184930840ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:52.306542 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-1f571b44-6be2-4467-b808-c184930840ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Getting quotas for project bf55d220c94d4445af9f73c532029e42. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:40:52.313748 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-1f571b44-6be2-4467-b808-c184930840ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Getting quotas for user 71c383c04f9543d8ab97a6c0db268ca5 and project bf55d220c94d4445af9f73c532029e42. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:40:52.331339 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1f571b44-6be2-4467-b808-c184930840ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Going to run 1 instances... {{(pid=124317) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 16:40:52.335562 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1f571b44-6be2-4467-b808-c184930840ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42a4b1a9-dea6-4c87-a2c1-328b9c0c8558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124317) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 16:40:52.424628 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e65993c7-1a6e-480c-922e-692198d40ca7 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:52.432569 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1f571b44-6be2-4467-b808-c184930840ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.748760 Jul 01 16:40:52.433691 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 20/41] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 1 16:40:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 1750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 16:40:52.443801 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e65993c7-1a6e-480c-922e-692198d40ca7 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1313 microversion: 2.1 time: 0.399261 Jul 01 16:40:52.444749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 22/42] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:52 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:52.448793 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-84baeb48-6c1e-4501-ba16-1b733b4f86a2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:52.451113 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-84baeb48-6c1e-4501-ba16-1b733b4f86a2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:52.471173 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-84baeb48-6c1e-4501-ba16-1b733b4f86a2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:52.472083 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-84baeb48-6c1e-4501-ba16-1b733b4f86a2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:52.474874 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-84baeb48-6c1e-4501-ba16-1b733b4f86a2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:52.478403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-84baeb48-6c1e-4501-ba16-1b733b4f86a2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:52.481913 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f8b7b401-95cc-48e5-9bbd-f0615e6c1d2e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:52.484984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f8b7b401-95cc-48e5-9bbd-f0615e6c1d2e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:52.621869 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-84baeb48-6c1e-4501-ba16-1b733b4f86a2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:52.650067 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-84baeb48-6c1e-4501-ba16-1b733b4f86a2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:52.655904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-84baeb48-6c1e-4501-ba16-1b733b4f86a2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:52.659865 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-84baeb48-6c1e-4501-ba16-1b733b4f86a2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1285 microversion: 2.20 time: 0.216820 Jul 01 16:40:52.671710 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 21/43] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:40:52 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1285 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:40:52.749181 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f8b7b401-95cc-48e5-9bbd-f0615e6c1d2e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:52.763873 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f8b7b401-95cc-48e5-9bbd-f0615e6c1d2e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1221 microversion: 2.1 time: 0.317610 Jul 01 16:40:52.769241 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 23/44] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:52 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1221 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:53.042787 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6a285348-b7db-44b6-89eb-49f8d3629c6f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:53.043557 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6a285348-b7db-44b6-89eb-49f8d3629c6f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:53.061461 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6a285348-b7db-44b6-89eb-49f8d3629c6f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:53.065166 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6a285348-b7db-44b6-89eb-49f8d3629c6f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:53.068253 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6a285348-b7db-44b6-89eb-49f8d3629c6f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:53.079914 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6a285348-b7db-44b6-89eb-49f8d3629c6f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:53.463323 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3aba35f9-58af-41b9-b367-9ac1d19afdb3 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:53.464024 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3aba35f9-58af-41b9-b367-9ac1d19afdb3 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:53.480518 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3aba35f9-58af-41b9-b367-9ac1d19afdb3 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:53.485896 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3aba35f9-58af-41b9-b367-9ac1d19afdb3 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:53.488106 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3aba35f9-58af-41b9-b367-9ac1d19afdb3 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:53.495084 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3aba35f9-58af-41b9-b367-9ac1d19afdb3 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:54.373836 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6a285348-b7db-44b6-89eb-49f8d3629c6f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:54.411868 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6a285348-b7db-44b6-89eb-49f8d3629c6f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1367 microversion: 2.1 time: 1.374302 Jul 01 16:40:54.423618 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 22/45] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:53 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1367 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:40:54.451016 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3aba35f9-58af-41b9-b367-9ac1d19afdb3 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:54.453062 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5660335a-a605-4133-8ee7-57f645c34111 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:54.455230 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5660335a-a605-4133-8ee7-57f645c34111 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:54.469450 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3aba35f9-58af-41b9-b367-9ac1d19afdb3 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1313 microversion: 2.1 time: 1.011138 Jul 01 16:40:54.473991 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 24/46] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:53 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1313 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:54.478441 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5660335a-a605-4133-8ee7-57f645c34111 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:54.480284 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5660335a-a605-4133-8ee7-57f645c34111 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:54.480588 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ea7ef750-1cd5-4aaf-b221-6c2a3410c9f8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:54.481343 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ea7ef750-1cd5-4aaf-b221-6c2a3410c9f8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:54.483471 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5660335a-a605-4133-8ee7-57f645c34111 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:54.484049 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5660335a-a605-4133-8ee7-57f645c34111 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:54.492003 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ea7ef750-1cd5-4aaf-b221-6c2a3410c9f8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:54.500820 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ea7ef750-1cd5-4aaf-b221-6c2a3410c9f8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:54.501946 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ea7ef750-1cd5-4aaf-b221-6c2a3410c9f8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:54.507728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ea7ef750-1cd5-4aaf-b221-6c2a3410c9f8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:54.661537 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5660335a-a605-4133-8ee7-57f645c34111 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:54.684727 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5660335a-a605-4133-8ee7-57f645c34111 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:54.699269 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ea7ef750-1cd5-4aaf-b221-6c2a3410c9f8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:54.699411 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5660335a-a605-4133-8ee7-57f645c34111 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:54.710681 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5660335a-a605-4133-8ee7-57f645c34111 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1333 microversion: 2.20 time: 0.278295 Jul 01 16:40:54.712953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 23/47] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:40:54 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1333 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:40:54.714189 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ea7ef750-1cd5-4aaf-b221-6c2a3410c9f8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1225 microversion: 2.1 time: 0.238857 Jul 01 16:40:54.714951 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 25/48] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:54 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1225 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:55.430050 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1b05f106-f5f5-4a1f-ad71-ba818be4f690 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:55.434173 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1b05f106-f5f5-4a1f-ad71-ba818be4f690 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:55.448317 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1b05f106-f5f5-4a1f-ad71-ba818be4f690 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:55.448733 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1b05f106-f5f5-4a1f-ad71-ba818be4f690 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:55.449706 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1b05f106-f5f5-4a1f-ad71-ba818be4f690 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:55.450360 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1b05f106-f5f5-4a1f-ad71-ba818be4f690 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:55.699803 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-1b05f106-f5f5-4a1f-ad71-ba818be4f690 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:55.713945 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1b05f106-f5f5-4a1f-ad71-ba818be4f690 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1367 microversion: 2.1 time: 0.288161 Jul 01 16:40:55.714580 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 26/49] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:55 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:40:55.729041 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-80dbc71b-9607-4658-987a-1ad0ad0dae48 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:55.729659 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-80dbc71b-9607-4658-987a-1ad0ad0dae48 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:55.756095 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-80dbc71b-9607-4658-987a-1ad0ad0dae48 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:55.758562 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-80dbc71b-9607-4658-987a-1ad0ad0dae48 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:55.761725 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-80dbc71b-9607-4658-987a-1ad0ad0dae48 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:55.763928 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-80dbc71b-9607-4658-987a-1ad0ad0dae48 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:55.846787 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-0b118e1f-4f14-4787-9364-3d0116269d30 req-5440108c-e4df-4b57-8467-5aef8aad1f6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a4f1396-f645-4238-850e-358ca184ad19", "tag": "d9188aa7-e096-4650-812e-94b0a5c94fda"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:40:55.869371 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-0b118e1f-4f14-4787-9364-3d0116269d30 req-5440108c-e4df-4b57-8467-5aef8aad1f6e service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:55.870153 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-0b118e1f-4f14-4787-9364-3d0116269d30 req-5440108c-e4df-4b57-8467-5aef8aad1f6e service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:55.894208 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-0b118e1f-4f14-4787-9364-3d0116269d30 req-5440108c-e4df-4b57-8467-5aef8aad1f6e service nova] Creating event network-changed:d9188aa7-e096-4650-812e-94b0a5c94fda for instance 5a4f1396-f645-4238-850e-358ca184ad19 on hv-cinder-79760 Jul 01 16:40:55.894811 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-0b118e1f-4f14-4787-9364-3d0116269d30 req-5440108c-e4df-4b57-8467-5aef8aad1f6e service nova] Acquired lock "compute-rpcapi-router" {{(pid=124317) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 16:40:55.896120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-99558c5b-cdcc-4836-a4a4-cb7f16f10893 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:55.896566 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-99558c5b-cdcc-4836-a4a4-cb7f16f10893 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:55.897383 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-99558c5b-cdcc-4836-a4a4-cb7f16f10893 None None] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:55.897820 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-99558c5b-cdcc-4836-a4a4-cb7f16f10893 None None] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:55.907384 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.compute.rpcapi [None req-99558c5b-cdcc-4836-a4a4-cb7f16f10893 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 01 16:40:55.908324 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-99558c5b-cdcc-4836-a4a4-cb7f16f10893 None None] Releasing lock "compute-rpcapi-router" {{(pid=124317) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 16:40:55.932703 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-99558c5b-cdcc-4836-a4a4-cb7f16f10893 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.770982 Jul 01 16:40:55.933396 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 24/50] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:40:55.939323 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-91b20e95-14d5-41be-ad44-7c2fc056ff01 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:55.941498 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-91b20e95-14d5-41be-ad44-7c2fc056ff01 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:55.950369 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-91b20e95-14d5-41be-ad44-7c2fc056ff01 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:55.951272 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-91b20e95-14d5-41be-ad44-7c2fc056ff01 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:55.952580 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-91b20e95-14d5-41be-ad44-7c2fc056ff01 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:55.953364 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-91b20e95-14d5-41be-ad44-7c2fc056ff01 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:56.020882 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-80dbc71b-9607-4658-987a-1ad0ad0dae48 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:56.034099 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-80dbc71b-9607-4658-987a-1ad0ad0dae48 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1313 microversion: 2.1 time: 0.318430 Jul 01 16:40:56.044943 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 27/51] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:55 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:56.045283 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-91b20e95-14d5-41be-ad44-7c2fc056ff01 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:56.047891 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d2b1fcec-eac3-4e50-80b1-b71c9630df07 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:56.054222 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d2b1fcec-eac3-4e50-80b1-b71c9630df07 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:56.056430 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-91b20e95-14d5-41be-ad44-7c2fc056ff01 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:56.058062 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-91b20e95-14d5-41be-ad44-7c2fc056ff01 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:56.059582 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-91b20e95-14d5-41be-ad44-7c2fc056ff01 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1333 microversion: 2.20 time: 0.124861 Jul 01 16:40:56.060517 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 25/52] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:40:55 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1333 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:40:56.063331 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d2b1fcec-eac3-4e50-80b1-b71c9630df07 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:56.064003 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d2b1fcec-eac3-4e50-80b1-b71c9630df07 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:56.065758 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d2b1fcec-eac3-4e50-80b1-b71c9630df07 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:56.066716 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d2b1fcec-eac3-4e50-80b1-b71c9630df07 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:56.142038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d2b1fcec-eac3-4e50-80b1-b71c9630df07 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:56.150847 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d2b1fcec-eac3-4e50-80b1-b71c9630df07 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1225 microversion: 2.1 time: 0.114078 Jul 01 16:40:56.151429 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 28/53] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:56 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:56.731989 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a2702088-1fa6-47c8-832a-ec98be746b04 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:56.732767 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a2702088-1fa6-47c8-832a-ec98be746b04 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:56.744632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a2702088-1fa6-47c8-832a-ec98be746b04 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:56.745084 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a2702088-1fa6-47c8-832a-ec98be746b04 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:56.745976 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a2702088-1fa6-47c8-832a-ec98be746b04 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:56.746294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a2702088-1fa6-47c8-832a-ec98be746b04 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:57.053647 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9ba35919-7b9b-47b1-bc9e-65fb03f3a252 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:57.055204 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9ba35919-7b9b-47b1-bc9e-65fb03f3a252 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:57.072023 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ba35919-7b9b-47b1-bc9e-65fb03f3a252 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:57.073105 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ba35919-7b9b-47b1-bc9e-65fb03f3a252 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:57.079478 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ba35919-7b9b-47b1-bc9e-65fb03f3a252 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:57.079973 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ba35919-7b9b-47b1-bc9e-65fb03f3a252 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:57.521132 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a2702088-1fa6-47c8-832a-ec98be746b04 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:57.525825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9ba35919-7b9b-47b1-bc9e-65fb03f3a252 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:57.531877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a2702088-1fa6-47c8-832a-ec98be746b04 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1367 microversion: 2.1 time: 0.803850 Jul 01 16:40:57.536466 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9ba35919-7b9b-47b1-bc9e-65fb03f3a252 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1313 microversion: 2.1 time: 0.487118 Jul 01 16:40:57.546893 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 26/54] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:56 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1367 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:57.548741 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 29/55] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:57 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1313 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:57.553624 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c866987e-933c-4780-b128-8086b73986c1 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:57.554242 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c866987e-933c-4780-b128-8086b73986c1 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:57.555184 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-81e13940-4c9d-48de-9096-6aa9f3e3795b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:57.555909 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-81e13940-4c9d-48de-9096-6aa9f3e3795b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:57.557336 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:57.564165 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-81e13940-4c9d-48de-9096-6aa9f3e3795b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:57.565307 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-81e13940-4c9d-48de-9096-6aa9f3e3795b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:57.566621 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-81e13940-4c9d-48de-9096-6aa9f3e3795b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:57.566998 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-81e13940-4c9d-48de-9096-6aa9f3e3795b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:57.574117 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c866987e-933c-4780-b128-8086b73986c1 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:57.574618 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c866987e-933c-4780-b128-8086b73986c1 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:57.575484 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c866987e-933c-4780-b128-8086b73986c1 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:57.576013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c866987e-933c-4780-b128-8086b73986c1 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:57.762371 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-81e13940-4c9d-48de-9096-6aa9f3e3795b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:57.773407 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-81e13940-4c9d-48de-9096-6aa9f3e3795b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1291 microversion: 2.1 time: 0.222527 Jul 01 16:40:57.783675 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 30/56] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:57 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1291 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:57.823085 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c866987e-933c-4780-b128-8086b73986c1 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:57.840380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c866987e-933c-4780-b128-8086b73986c1 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:57.843652 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c866987e-933c-4780-b128-8086b73986c1 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:57.849332 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c866987e-933c-4780-b128-8086b73986c1 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1339 microversion: 2.20 time: 0.295092 Jul 01 16:40:57.850336 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 27/57] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:40:57 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1339 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:40:58.558334 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7ddb9fc9-d407-4ad4-8d72-2326b2314202 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:58.560841 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-66132509-609f-487d-833a-f1b8e56681ad tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:58.561980 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7ddb9fc9-d407-4ad4-8d72-2326b2314202 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:58.562789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-66132509-609f-487d-833a-f1b8e56681ad tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:58.595372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7ddb9fc9-d407-4ad4-8d72-2326b2314202 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:58.600028 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-66132509-609f-487d-833a-f1b8e56681ad tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:58.602411 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-66132509-609f-487d-833a-f1b8e56681ad tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:58.603421 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-66132509-609f-487d-833a-f1b8e56681ad tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:58.603706 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7ddb9fc9-d407-4ad4-8d72-2326b2314202 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:58.605127 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-66132509-609f-487d-833a-f1b8e56681ad tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:58.606615 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7ddb9fc9-d407-4ad4-8d72-2326b2314202 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:58.608036 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7ddb9fc9-d407-4ad4-8d72-2326b2314202 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:58.655833 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=100 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:59.264694 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-66132509-609f-487d-833a-f1b8e56681ad tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:59.273049 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-66132509-609f-487d-833a-f1b8e56681ad tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1367 microversion: 2.1 time: 0.725918 Jul 01 16:40:59.273632 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 31/58] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:58 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1367 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:59.280376 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-67607135-c5f9-4d18-9aaa-ce6dca04f430 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:59.281161 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-67607135-c5f9-4d18-9aaa-ce6dca04f430 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:59.291816 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-67607135-c5f9-4d18-9aaa-ce6dca04f430 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:59.293124 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-67607135-c5f9-4d18-9aaa-ce6dca04f430 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:59.294102 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-67607135-c5f9-4d18-9aaa-ce6dca04f430 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:59.294798 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-67607135-c5f9-4d18-9aaa-ce6dca04f430 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:59.318597 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7ddb9fc9-d407-4ad4-8d72-2326b2314202 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:59.333763 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7ddb9fc9-d407-4ad4-8d72-2326b2314202 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1313 microversion: 2.1 time: 0.779827 Jul 01 16:40:59.344364 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 28/59] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:58 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1313 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:59.345196 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-422a441d-ad94-4655-8c26-f2e2f02da24a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:40:59.346967 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-422a441d-ad94-4655-8c26-f2e2f02da24a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:40:59.355169 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-422a441d-ad94-4655-8c26-f2e2f02da24a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:59.355169 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-422a441d-ad94-4655-8c26-f2e2f02da24a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:59.355424 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-422a441d-ad94-4655-8c26-f2e2f02da24a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:40:59.356098 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-422a441d-ad94-4655-8c26-f2e2f02da24a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:40:59.404117 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-67607135-c5f9-4d18-9aaa-ce6dca04f430 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:59.413488 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-67607135-c5f9-4d18-9aaa-ce6dca04f430 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1279 microversion: 2.1 time: 0.138595 Jul 01 16:40:59.415178 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 32/60] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:40:59 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1279 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:40:59.484277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-422a441d-ad94-4655-8c26-f2e2f02da24a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:59.493066 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-422a441d-ad94-4655-8c26-f2e2f02da24a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:59.494619 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-422a441d-ad94-4655-8c26-f2e2f02da24a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:40:59.495723 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-422a441d-ad94-4655-8c26-f2e2f02da24a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1339 microversion: 2.20 time: 0.158994 Jul 01 16:40:59.496536 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 29/61] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:40:59 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1339 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:41:00.291176 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f2386745-e2db-4efd-b63b-a8cc83d9ff15 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:00.292353 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f2386745-e2db-4efd-b63b-a8cc83d9ff15 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:00.301084 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f2386745-e2db-4efd-b63b-a8cc83d9ff15 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:00.301530 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f2386745-e2db-4efd-b63b-a8cc83d9ff15 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:00.302310 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f2386745-e2db-4efd-b63b-a8cc83d9ff15 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:00.312260 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f2386745-e2db-4efd-b63b-a8cc83d9ff15 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:00.352363 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e4adb867-6a43-42b7-b7f2-e5a1ee88f67b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:00.357470 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e4adb867-6a43-42b7-b7f2-e5a1ee88f67b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:00.369007 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e4adb867-6a43-42b7-b7f2-e5a1ee88f67b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:00.372881 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e4adb867-6a43-42b7-b7f2-e5a1ee88f67b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:00.375633 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e4adb867-6a43-42b7-b7f2-e5a1ee88f67b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:00.376262 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e4adb867-6a43-42b7-b7f2-e5a1ee88f67b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:01.059893 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e4adb867-6a43-42b7-b7f2-e5a1ee88f67b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:01.061965 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f2386745-e2db-4efd-b63b-a8cc83d9ff15 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:01.066963 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=95 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:01.072029 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f2386745-e2db-4efd-b63b-a8cc83d9ff15 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1367 microversion: 2.1 time: 0.784873 Jul 01 16:41:01.084549 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 33/62] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:00 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1367 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:01.086977 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e4adb867-6a43-42b7-b7f2-e5a1ee88f67b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1313 microversion: 2.1 time: 0.738129 Jul 01 16:41:01.088675 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 30/63] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:00 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1313 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:41:01.094685 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d27ac231-7d0c-4d17-bfde-0f860c4c6657 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:01.094685 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d27ac231-7d0c-4d17-bfde-0f860c4c6657 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:01.103878 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-601bd68a-2afd-43c5-9c4a-d3ba6651c124 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:01.104085 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-601bd68a-2afd-43c5-9c4a-d3ba6651c124 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:01.122097 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-601bd68a-2afd-43c5-9c4a-d3ba6651c124 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:01.122854 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-601bd68a-2afd-43c5-9c4a-d3ba6651c124 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:01.123988 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-601bd68a-2afd-43c5-9c4a-d3ba6651c124 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:01.124709 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-601bd68a-2afd-43c5-9c4a-d3ba6651c124 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:01.126862 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d27ac231-7d0c-4d17-bfde-0f860c4c6657 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:01.131152 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d27ac231-7d0c-4d17-bfde-0f860c4c6657 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:01.137472 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d27ac231-7d0c-4d17-bfde-0f860c4c6657 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:01.139731 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d27ac231-7d0c-4d17-bfde-0f860c4c6657 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:01.302858 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=4 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:01.581853 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-601bd68a-2afd-43c5-9c4a-d3ba6651c124 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:01.596248 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-601bd68a-2afd-43c5-9c4a-d3ba6651c124 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:01.599398 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-601bd68a-2afd-43c5-9c4a-d3ba6651c124 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:01.602694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-601bd68a-2afd-43c5-9c4a-d3ba6651c124 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1406 microversion: 2.20 time: 0.508558 Jul 01 16:41:01.607171 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 31/64] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:41:01 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1406 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:41:01.656728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d27ac231-7d0c-4d17-bfde-0f860c4c6657 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:01.667598 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d27ac231-7d0c-4d17-bfde-0f860c4c6657 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1321 microversion: 2.1 time: 0.581651 Jul 01 16:41:01.668539 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 34/65] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:01 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1321 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:02.094469 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4f6516d7-5bca-40b7-ad9a-94eb8d6cb6b9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:02.096258 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4f6516d7-5bca-40b7-ad9a-94eb8d6cb6b9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:02.107798 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4580a70b-e241-47d4-9c28-498efe8f0ca0 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:02.108812 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4580a70b-e241-47d4-9c28-498efe8f0ca0 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:02.126503 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4580a70b-e241-47d4-9c28-498efe8f0ca0 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:02.127971 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4580a70b-e241-47d4-9c28-498efe8f0ca0 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:02.128508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4f6516d7-5bca-40b7-ad9a-94eb8d6cb6b9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:02.129216 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4f6516d7-5bca-40b7-ad9a-94eb8d6cb6b9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:02.131154 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4580a70b-e241-47d4-9c28-498efe8f0ca0 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:02.132838 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4f6516d7-5bca-40b7-ad9a-94eb8d6cb6b9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:02.135364 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4f6516d7-5bca-40b7-ad9a-94eb8d6cb6b9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:02.135565 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4580a70b-e241-47d4-9c28-498efe8f0ca0 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:02.324722 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=28 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:02.761650 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=10 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:03.057177 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4580a70b-e241-47d4-9c28-498efe8f0ca0 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:03.070460 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4580a70b-e241-47d4-9c28-498efe8f0ca0 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1313 microversion: 2.1 time: 0.967598 Jul 01 16:41:03.079553 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 35/66] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:02 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1313 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:41:03.088410 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4f6516d7-5bca-40b7-ad9a-94eb8d6cb6b9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:03.099958 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-9435f0d9-ebf9-4844-a2d8-2e410984a33f req-22a98b6a-062c-4fb0-997d-45e21316f216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8498c0a8-d20e-4261-a0a1-d4c33004141c", "tag": "2c1b8fc6-0b53-4c5c-83ee-2d68d226acfa"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:41:03.106968 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4f6516d7-5bca-40b7-ad9a-94eb8d6cb6b9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1367 microversion: 2.1 time: 1.019053 Jul 01 16:41:03.108690 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 32/67] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:02 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1367 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:03.132216 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-c507ee96-8409-4e1c-8866-ee876d0df9bf req-fd47ece6-6078-4c8a-ba22-3ff24488b630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccdab81c-96e6-4936-8bd6-fe8a3ea5e956", "tag": "6734072e-1ee7-4702-af2c-30d3cd1f8189"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:41:03.162465 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-9435f0d9-ebf9-4844-a2d8-2e410984a33f req-22a98b6a-062c-4fb0-997d-45e21316f216 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:03.165050 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-9435f0d9-ebf9-4844-a2d8-2e410984a33f req-22a98b6a-062c-4fb0-997d-45e21316f216 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:03.169595 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-c507ee96-8409-4e1c-8866-ee876d0df9bf req-fd47ece6-6078-4c8a-ba22-3ff24488b630 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:03.170157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-c507ee96-8409-4e1c-8866-ee876d0df9bf req-fd47ece6-6078-4c8a-ba22-3ff24488b630 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:03.212696 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-c507ee96-8409-4e1c-8866-ee876d0df9bf req-fd47ece6-6078-4c8a-ba22-3ff24488b630 service nova] Creating event network-changed:6734072e-1ee7-4702-af2c-30d3cd1f8189 for instance ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 on hv-cinder-79760 Jul 01 16:41:03.217937 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-9435f0d9-ebf9-4844-a2d8-2e410984a33f req-22a98b6a-062c-4fb0-997d-45e21316f216 service nova] Creating event network-changed:2c1b8fc6-0b53-4c5c-83ee-2d68d226acfa for instance 8498c0a8-d20e-4261-a0a1-d4c33004141c on hv-cinder-79760 Jul 01 16:41:03.226274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-c507ee96-8409-4e1c-8866-ee876d0df9bf req-fd47ece6-6078-4c8a-ba22-3ff24488b630 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115003 Jul 01 16:41:03.227275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 33/68] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:41:03.238235 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-9435f0d9-ebf9-4844-a2d8-2e410984a33f req-22a98b6a-062c-4fb0-997d-45e21316f216 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151815 Jul 01 16:41:03.240332 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 36/69] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:41:03.253296 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a7a04846-6e48-45d4-9b98-2756ee54fd6d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:03.258001 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a7a04846-6e48-45d4-9b98-2756ee54fd6d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:03.258269 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-81069dbe-9aaf-46c2-a4fc-4b9b91f640ea tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:03.259751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-81069dbe-9aaf-46c2-a4fc-4b9b91f640ea tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:03.265854 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a7a04846-6e48-45d4-9b98-2756ee54fd6d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:03.266547 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a7a04846-6e48-45d4-9b98-2756ee54fd6d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:03.268661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a7a04846-6e48-45d4-9b98-2756ee54fd6d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:03.269354 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a7a04846-6e48-45d4-9b98-2756ee54fd6d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:03.310714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-81069dbe-9aaf-46c2-a4fc-4b9b91f640ea tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:03.311601 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-81069dbe-9aaf-46c2-a4fc-4b9b91f640ea tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:03.314130 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-81069dbe-9aaf-46c2-a4fc-4b9b91f640ea tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:03.317566 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-81069dbe-9aaf-46c2-a4fc-4b9b91f640ea tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:03.982294 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-81069dbe-9aaf-46c2-a4fc-4b9b91f640ea tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:03.999557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-81069dbe-9aaf-46c2-a4fc-4b9b91f640ea tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1321 microversion: 2.1 time: 0.757267 Jul 01 16:41:04.001528 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 37/70] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:03 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1321 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:04.020770 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a7a04846-6e48-45d4-9b98-2756ee54fd6d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:04.036482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a7a04846-6e48-45d4-9b98-2756ee54fd6d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:04.042243 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a7a04846-6e48-45d4-9b98-2756ee54fd6d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:04.044084 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a7a04846-6e48-45d4-9b98-2756ee54fd6d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1406 microversion: 2.20 time: 0.815692 Jul 01 16:41:04.047806 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 34/71] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:41:03 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1406 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:41:04.098721 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8600ca57-1a1c-41bd-a157-31665c991d26 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:04.099895 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8600ca57-1a1c-41bd-a157-31665c991d26 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:04.107468 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8600ca57-1a1c-41bd-a157-31665c991d26 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:04.108198 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8600ca57-1a1c-41bd-a157-31665c991d26 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:04.109203 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8600ca57-1a1c-41bd-a157-31665c991d26 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:04.110548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8600ca57-1a1c-41bd-a157-31665c991d26 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:04.124289 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-bf0a93fe-175e-489e-a841-30297f4a0aa3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:04.125127 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-bf0a93fe-175e-489e-a841-30297f4a0aa3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:04.141523 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bf0a93fe-175e-489e-a841-30297f4a0aa3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:04.141876 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bf0a93fe-175e-489e-a841-30297f4a0aa3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:04.143476 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bf0a93fe-175e-489e-a841-30297f4a0aa3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:04.144124 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bf0a93fe-175e-489e-a841-30297f4a0aa3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:04.379613 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8600ca57-1a1c-41bd-a157-31665c991d26 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:04.390523 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8600ca57-1a1c-41bd-a157-31665c991d26 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1313 microversion: 2.1 time: 0.294176 Jul 01 16:41:04.391460 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 38/72] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:04 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:04.400519 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bf0a93fe-175e-489e-a841-30297f4a0aa3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:04.412007 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-bf0a93fe-175e-489e-a841-30297f4a0aa3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1367 microversion: 2.1 time: 0.291612 Jul 01 16:41:04.413033 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 35/73] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:04 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:41:05.018586 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ef40aa43-c682-4ecf-88af-74e6c16b3587 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:05.019539 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ef40aa43-c682-4ecf-88af-74e6c16b3587 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:05.021880 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:05.028545 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ef40aa43-c682-4ecf-88af-74e6c16b3587 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:05.029675 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ef40aa43-c682-4ecf-88af-74e6c16b3587 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:05.030664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ef40aa43-c682-4ecf-88af-74e6c16b3587 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:05.040242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ef40aa43-c682-4ecf-88af-74e6c16b3587 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:05.065859 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8aac2657-50f4-4d01-9997-0ff018ecc8c2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:05.066775 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8aac2657-50f4-4d01-9997-0ff018ecc8c2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:05.076877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8aac2657-50f4-4d01-9997-0ff018ecc8c2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:05.077368 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8aac2657-50f4-4d01-9997-0ff018ecc8c2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:05.078437 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8aac2657-50f4-4d01-9997-0ff018ecc8c2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:05.078979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8aac2657-50f4-4d01-9997-0ff018ecc8c2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:05.522860 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ef40aa43-c682-4ecf-88af-74e6c16b3587 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:05.528588 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8aac2657-50f4-4d01-9997-0ff018ecc8c2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:05.539730 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ef40aa43-c682-4ecf-88af-74e6c16b3587 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1321 microversion: 2.1 time: 0.525204 Jul 01 16:41:05.540378 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 39/74] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:05 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1321 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:05.542011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8aac2657-50f4-4d01-9997-0ff018ecc8c2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:05.544240 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8aac2657-50f4-4d01-9997-0ff018ecc8c2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:05.545550 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8aac2657-50f4-4d01-9997-0ff018ecc8c2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1406 microversion: 2.20 time: 0.484516 Jul 01 16:41:05.546690 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 36/75] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:41:05 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1406 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:41:05.557798 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-6f1ee5ec-922d-43a4-8df1-c7ae3448470c req-b1d942a2-255c-4eb7-8aea-2b6a2e033ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5", "tag": "bdfbafea-3e39-44d2-9b40-9668e19b3334"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:41:05.571580 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-6f1ee5ec-922d-43a4-8df1-c7ae3448470c req-b1d942a2-255c-4eb7-8aea-2b6a2e033ce2 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:05.572224 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-6f1ee5ec-922d-43a4-8df1-c7ae3448470c req-b1d942a2-255c-4eb7-8aea-2b6a2e033ce2 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:05.585727 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-6f1ee5ec-922d-43a4-8df1-c7ae3448470c req-b1d942a2-255c-4eb7-8aea-2b6a2e033ce2 service nova] Creating event network-changed:bdfbafea-3e39-44d2-9b40-9668e19b3334 for instance a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 on hv-cinder-79760 Jul 01 16:41:05.592376 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-6f1ee5ec-922d-43a4-8df1-c7ae3448470c req-b1d942a2-255c-4eb7-8aea-2b6a2e033ce2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044081 Jul 01 16:41:05.593183 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 37/76] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:41:05.599615 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c7bb8a4b-2710-45a7-8acf-2e78595f418c tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:05.600385 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c7bb8a4b-2710-45a7-8acf-2e78595f418c tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:05.606745 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c7bb8a4b-2710-45a7-8acf-2e78595f418c tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:05.607201 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c7bb8a4b-2710-45a7-8acf-2e78595f418c tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:05.608064 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c7bb8a4b-2710-45a7-8acf-2e78595f418c tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:05.608684 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c7bb8a4b-2710-45a7-8acf-2e78595f418c tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:05.771076 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c7bb8a4b-2710-45a7-8acf-2e78595f418c tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:05.781026 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c7bb8a4b-2710-45a7-8acf-2e78595f418c tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1313 microversion: 2.1 time: 0.186474 Jul 01 16:41:05.782366 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 38/77] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:05 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:05.808087 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-681d85d6-ac41-41b3-8183-2283294be7ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:05.810922 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-681d85d6-ac41-41b3-8183-2283294be7ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:05.818819 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-681d85d6-ac41-41b3-8183-2283294be7ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:05.819569 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-681d85d6-ac41-41b3-8183-2283294be7ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:05.820534 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-681d85d6-ac41-41b3-8183-2283294be7ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:05.821047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-681d85d6-ac41-41b3-8183-2283294be7ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:05.849801 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-6ea0a07f-f724-4b83-8886-2b43db5c912a req-7f5f0513-4cd6-4bf7-8df7-e469c8ec29a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4f1396-f645-4238-850e-358ca184ad19", "name": "network-vif-plugged", "status": "completed", "tag": "d9188aa7-e096-4650-812e-94b0a5c94fda"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:41:05.876382 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-6ea0a07f-f724-4b83-8886-2b43db5c912a req-7f5f0513-4cd6-4bf7-8df7-e469c8ec29a6 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:05.877763 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-6ea0a07f-f724-4b83-8886-2b43db5c912a req-7f5f0513-4cd6-4bf7-8df7-e469c8ec29a6 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:05.899556 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-6ea0a07f-f724-4b83-8886-2b43db5c912a req-7f5f0513-4cd6-4bf7-8df7-e469c8ec29a6 service nova] Creating event network-vif-plugged:d9188aa7-e096-4650-812e-94b0a5c94fda for instance 5a4f1396-f645-4238-850e-358ca184ad19 on hv-cinder-79760 Jul 01 16:41:05.905519 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=10 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:05.907700 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-6ea0a07f-f724-4b83-8886-2b43db5c912a req-7f5f0513-4cd6-4bf7-8df7-e469c8ec29a6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.365604 Jul 01 16:41:05.908536 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 40/78] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:41:06.402139 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-681d85d6-ac41-41b3-8183-2283294be7ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:06.417317 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-681d85d6-ac41-41b3-8183-2283294be7ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1367 microversion: 2.1 time: 0.633535 Jul 01 16:41:06.418993 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 39/79] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:05 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1367 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:06.565979 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ef74c6b9-1bd1-48bd-81e1-6d0e51437fc0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:06.566695 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ef74c6b9-1bd1-48bd-81e1-6d0e51437fc0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:06.573619 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c5f957f8-e087-4c10-8400-bc42a07801c9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:06.575309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c5f957f8-e087-4c10-8400-bc42a07801c9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:06.594437 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c5f957f8-e087-4c10-8400-bc42a07801c9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:06.596237 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c5f957f8-e087-4c10-8400-bc42a07801c9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:06.601508 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ef74c6b9-1bd1-48bd-81e1-6d0e51437fc0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:06.602754 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c5f957f8-e087-4c10-8400-bc42a07801c9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:06.603556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c5f957f8-e087-4c10-8400-bc42a07801c9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:06.606131 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ef74c6b9-1bd1-48bd-81e1-6d0e51437fc0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:06.610219 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ef74c6b9-1bd1-48bd-81e1-6d0e51437fc0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:06.610997 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ef74c6b9-1bd1-48bd-81e1-6d0e51437fc0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:06.990988 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c5f957f8-e087-4c10-8400-bc42a07801c9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:06.998651 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c5f957f8-e087-4c10-8400-bc42a07801c9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:07.000628 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c5f957f8-e087-4c10-8400-bc42a07801c9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:07.002593 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c5f957f8-e087-4c10-8400-bc42a07801c9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1406 microversion: 2.20 time: 0.441636 Jul 01 16:41:07.004200 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 40/80] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:41:06 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1406 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:41:07.011919 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6bcfcf98-68d2-4e9b-99d3-418618e708cd tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:07.012812 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6bcfcf98-68d2-4e9b-99d3-418618e708cd tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:07.025642 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6bcfcf98-68d2-4e9b-99d3-418618e708cd tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:07.026540 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6bcfcf98-68d2-4e9b-99d3-418618e708cd tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:07.027053 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ef74c6b9-1bd1-48bd-81e1-6d0e51437fc0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:07.027913 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6bcfcf98-68d2-4e9b-99d3-418618e708cd tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:07.028529 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6bcfcf98-68d2-4e9b-99d3-418618e708cd tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:07.059536 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ef74c6b9-1bd1-48bd-81e1-6d0e51437fc0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1321 microversion: 2.1 time: 0.506646 Jul 01 16:41:07.066023 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 41/81] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:06 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1321 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:07.293232 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6bcfcf98-68d2-4e9b-99d3-418618e708cd tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:07.304449 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6bcfcf98-68d2-4e9b-99d3-418618e708cd tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1313 microversion: 2.1 time: 0.298695 Jul 01 16:41:07.305131 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 41/82] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:07 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:07.436467 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-27acaa5f-c174-4889-87df-749d40ccd9a0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:07.437079 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-27acaa5f-c174-4889-87df-749d40ccd9a0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:07.448880 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-27acaa5f-c174-4889-87df-749d40ccd9a0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:07.449734 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-27acaa5f-c174-4889-87df-749d40ccd9a0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:07.451107 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-27acaa5f-c174-4889-87df-749d40ccd9a0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:07.451766 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-27acaa5f-c174-4889-87df-749d40ccd9a0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:07.628669 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-27acaa5f-c174-4889-87df-749d40ccd9a0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:07.638305 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-27acaa5f-c174-4889-87df-749d40ccd9a0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1367 microversion: 2.1 time: 0.205301 Jul 01 16:41:07.639180 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 42/83] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:07 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:07.922615 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-918e4bce-5257-4521-a871-429a5816def6 req-5230b853-f529-4e37-8ec1-3847795b311b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb792a6-440e-4a96-89d8-3b65ee1a5a2e", "name": "network-vif-plugged", "status": "completed", "tag": "0d85f90c-e016-4950-ba0b-5986f1ed198f"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:41:07.932388 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-918e4bce-5257-4521-a871-429a5816def6 req-5230b853-f529-4e37-8ec1-3847795b311b service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:07.932835 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-918e4bce-5257-4521-a871-429a5816def6 req-5230b853-f529-4e37-8ec1-3847795b311b service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:07.944648 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-918e4bce-5257-4521-a871-429a5816def6 req-5230b853-f529-4e37-8ec1-3847795b311b service nova] Creating event network-vif-plugged:0d85f90c-e016-4950-ba0b-5986f1ed198f for instance bdb792a6-440e-4a96-89d8-3b65ee1a5a2e on hv-cinder-79760 Jul 01 16:41:07.949714 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-918e4bce-5257-4521-a871-429a5816def6 req-5230b853-f529-4e37-8ec1-3847795b311b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031382 Jul 01 16:41:07.950270 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 42/84] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:41:08.021676 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-48d75613-f37e-4e7d-9235-a12cb785a69e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:08.022330 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-48d75613-f37e-4e7d-9235-a12cb785a69e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:08.028786 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-48d75613-f37e-4e7d-9235-a12cb785a69e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:08.029241 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-48d75613-f37e-4e7d-9235-a12cb785a69e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:08.030007 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-48d75613-f37e-4e7d-9235-a12cb785a69e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:08.030490 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-48d75613-f37e-4e7d-9235-a12cb785a69e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:08.082837 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f20457f4-d6dc-4730-b648-4725d819ffb4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:08.083547 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f20457f4-d6dc-4730-b648-4725d819ffb4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:08.090326 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f20457f4-d6dc-4730-b648-4725d819ffb4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:08.090814 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f20457f4-d6dc-4730-b648-4725d819ffb4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:08.091589 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f20457f4-d6dc-4730-b648-4725d819ffb4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:08.092063 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f20457f4-d6dc-4730-b648-4725d819ffb4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:08.207801 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-48d75613-f37e-4e7d-9235-a12cb785a69e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:08.216772 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-48d75613-f37e-4e7d-9235-a12cb785a69e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:08.218266 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-48d75613-f37e-4e7d-9235-a12cb785a69e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:08.219439 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-48d75613-f37e-4e7d-9235-a12cb785a69e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1406 microversion: 2.20 time: 0.202434 Jul 01 16:41:08.220179 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 43/85] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:41:08 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:41:08.266936 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f20457f4-d6dc-4730-b648-4725d819ffb4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:08.275881 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f20457f4-d6dc-4730-b648-4725d819ffb4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1321 microversion: 2.1 time: 0.198003 Jul 01 16:41:08.276465 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 43/86] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:08 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:41:08.320957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a4eea427-2673-4aa5-99c2-875c2e8c0ca1 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:08.321603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a4eea427-2673-4aa5-99c2-875c2e8c0ca1 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:08.327719 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a4eea427-2673-4aa5-99c2-875c2e8c0ca1 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:08.328173 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a4eea427-2673-4aa5-99c2-875c2e8c0ca1 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:08.328934 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a4eea427-2673-4aa5-99c2-875c2e8c0ca1 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:08.329377 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a4eea427-2673-4aa5-99c2-875c2e8c0ca1 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:08.495644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a4eea427-2673-4aa5-99c2-875c2e8c0ca1 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:08.505900 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a4eea427-2673-4aa5-99c2-875c2e8c0ca1 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1313 microversion: 2.1 time: 0.188703 Jul 01 16:41:08.506508 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 44/87] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:08 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:08.658239 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5fcabe94-3aa3-4a58-9798-445014e00235 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:08.664186 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5fcabe94-3aa3-4a58-9798-445014e00235 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:08.672016 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5fcabe94-3aa3-4a58-9798-445014e00235 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:08.672852 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5fcabe94-3aa3-4a58-9798-445014e00235 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:08.673780 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5fcabe94-3aa3-4a58-9798-445014e00235 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:08.674518 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5fcabe94-3aa3-4a58-9798-445014e00235 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:08.829355 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5fcabe94-3aa3-4a58-9798-445014e00235 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:08.844210 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5fcabe94-3aa3-4a58-9798-445014e00235 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1367 microversion: 2.1 time: 0.189862 Jul 01 16:41:08.844959 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 44/88] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:08 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:09.237928 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c38a01c3-bfb7-455b-9e52-a50cd19f9047 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:09.238597 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c38a01c3-bfb7-455b-9e52-a50cd19f9047 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:09.245612 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c38a01c3-bfb7-455b-9e52-a50cd19f9047 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:09.246086 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c38a01c3-bfb7-455b-9e52-a50cd19f9047 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:09.246888 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c38a01c3-bfb7-455b-9e52-a50cd19f9047 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:09.247323 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c38a01c3-bfb7-455b-9e52-a50cd19f9047 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:09.294841 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8618348c-d288-48aa-a3e5-bff0377343c8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:09.296357 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8618348c-d288-48aa-a3e5-bff0377343c8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:09.304736 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8618348c-d288-48aa-a3e5-bff0377343c8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:09.305471 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8618348c-d288-48aa-a3e5-bff0377343c8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:09.306936 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8618348c-d288-48aa-a3e5-bff0377343c8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:09.307831 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8618348c-d288-48aa-a3e5-bff0377343c8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:09.437602 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c38a01c3-bfb7-455b-9e52-a50cd19f9047 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:09.446922 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c38a01c3-bfb7-455b-9e52-a50cd19f9047 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:09.448706 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c38a01c3-bfb7-455b-9e52-a50cd19f9047 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:09.450008 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c38a01c3-bfb7-455b-9e52-a50cd19f9047 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1406 microversion: 2.20 time: 0.216494 Jul 01 16:41:09.450766 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 45/89] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:41:09 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:41:09.508868 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8618348c-d288-48aa-a3e5-bff0377343c8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:09.516885 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8618348c-d288-48aa-a3e5-bff0377343c8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1321 microversion: 2.1 time: 0.226675 Jul 01 16:41:09.534595 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-756693dc-674c-47e6-a6e3-5a1c18c9ea51 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:09.535570 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-756693dc-674c-47e6-a6e3-5a1c18c9ea51 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:09.540348 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 45/90] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:09 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:09.542017 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-756693dc-674c-47e6-a6e3-5a1c18c9ea51 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:09.542890 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-756693dc-674c-47e6-a6e3-5a1c18c9ea51 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:09.543613 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-756693dc-674c-47e6-a6e3-5a1c18c9ea51 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:09.544202 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-756693dc-674c-47e6-a6e3-5a1c18c9ea51 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:09.714165 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-756693dc-674c-47e6-a6e3-5a1c18c9ea51 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:09.721735 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-756693dc-674c-47e6-a6e3-5a1c18c9ea51 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1313 microversion: 2.1 time: 0.191586 Jul 01 16:41:09.722572 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 46/91] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:09 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:09.862137 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-02b17e81-4897-40ca-8634-d8d02454779c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:09.862775 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-02b17e81-4897-40ca-8634-d8d02454779c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:09.869349 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-02b17e81-4897-40ca-8634-d8d02454779c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:09.869799 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-02b17e81-4897-40ca-8634-d8d02454779c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:09.870600 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-02b17e81-4897-40ca-8634-d8d02454779c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:09.871037 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-02b17e81-4897-40ca-8634-d8d02454779c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:10.015443 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-02b17e81-4897-40ca-8634-d8d02454779c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:10.023855 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-02b17e81-4897-40ca-8634-d8d02454779c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1367 microversion: 2.1 time: 0.165572 Jul 01 16:41:10.024704 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 46/92] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:09 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:41:10.468864 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cc5a0f63-306f-45f1-9307-7ee9df16a247 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:10.469469 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-cc5a0f63-306f-45f1-9307-7ee9df16a247 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:10.475581 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cc5a0f63-306f-45f1-9307-7ee9df16a247 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:10.476041 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cc5a0f63-306f-45f1-9307-7ee9df16a247 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:10.476795 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cc5a0f63-306f-45f1-9307-7ee9df16a247 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:10.477219 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cc5a0f63-306f-45f1-9307-7ee9df16a247 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:10.536729 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7ea23321-1d0f-42ed-b3e7-e9c3a1ad1c63 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:10.537427 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7ea23321-1d0f-42ed-b3e7-e9c3a1ad1c63 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:10.543939 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7ea23321-1d0f-42ed-b3e7-e9c3a1ad1c63 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:10.544395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7ea23321-1d0f-42ed-b3e7-e9c3a1ad1c63 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:10.545214 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7ea23321-1d0f-42ed-b3e7-e9c3a1ad1c63 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:10.545737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7ea23321-1d0f-42ed-b3e7-e9c3a1ad1c63 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:10.697262 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-cc5a0f63-306f-45f1-9307-7ee9df16a247 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:10.706387 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-cc5a0f63-306f-45f1-9307-7ee9df16a247 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:10.708838 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-cc5a0f63-306f-45f1-9307-7ee9df16a247 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:10.710269 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-cc5a0f63-306f-45f1-9307-7ee9df16a247 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1406 microversion: 2.20 time: 0.245244 Jul 01 16:41:10.710844 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 47/93] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:41:10 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:41:10.738603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-26b9a19f-81ab-416d-b86f-0bbbd69361b4 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:10.739215 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-26b9a19f-81ab-416d-b86f-0bbbd69361b4 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:10.741930 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7ea23321-1d0f-42ed-b3e7-e9c3a1ad1c63 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:10.747092 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-26b9a19f-81ab-416d-b86f-0bbbd69361b4 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:10.747781 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-26b9a19f-81ab-416d-b86f-0bbbd69361b4 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:10.748650 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-26b9a19f-81ab-416d-b86f-0bbbd69361b4 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:10.749119 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-26b9a19f-81ab-416d-b86f-0bbbd69361b4 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:10.751465 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7ea23321-1d0f-42ed-b3e7-e9c3a1ad1c63 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1321 microversion: 2.1 time: 0.218122 Jul 01 16:41:10.752816 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 47/94] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:10 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:10.900444 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-26b9a19f-81ab-416d-b86f-0bbbd69361b4 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:10.909996 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-26b9a19f-81ab-416d-b86f-0bbbd69361b4 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1313 microversion: 2.1 time: 0.175206 Jul 01 16:41:10.911207 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 48/95] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:10 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:11.040420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8a0fd1a4-21f4-415e-9a86-2a9ad8b14995 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:11.041021 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8a0fd1a4-21f4-415e-9a86-2a9ad8b14995 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:11.050210 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8a0fd1a4-21f4-415e-9a86-2a9ad8b14995 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:11.050686 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8a0fd1a4-21f4-415e-9a86-2a9ad8b14995 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:11.051457 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8a0fd1a4-21f4-415e-9a86-2a9ad8b14995 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:11.051895 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8a0fd1a4-21f4-415e-9a86-2a9ad8b14995 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:11.196594 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8a0fd1a4-21f4-415e-9a86-2a9ad8b14995 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:11.204696 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8a0fd1a4-21f4-415e-9a86-2a9ad8b14995 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1367 microversion: 2.1 time: 0.167994 Jul 01 16:41:11.206283 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 48/96] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:11 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:11.732342 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-db79fb04-980a-46e3-a9a7-ee5f4b65c718 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:11.733048 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-db79fb04-980a-46e3-a9a7-ee5f4b65c718 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:11.739795 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-db79fb04-980a-46e3-a9a7-ee5f4b65c718 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:11.740319 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-db79fb04-980a-46e3-a9a7-ee5f4b65c718 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:11.741142 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-db79fb04-980a-46e3-a9a7-ee5f4b65c718 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:11.741641 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-db79fb04-980a-46e3-a9a7-ee5f4b65c718 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:11.762090 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=100 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:11.772020 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d26cf4f9-6917-40f4-8669-7ac0c9508cb0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:11.772761 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d26cf4f9-6917-40f4-8669-7ac0c9508cb0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:11.778921 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d26cf4f9-6917-40f4-8669-7ac0c9508cb0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:11.779789 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d26cf4f9-6917-40f4-8669-7ac0c9508cb0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:11.780662 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d26cf4f9-6917-40f4-8669-7ac0c9508cb0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:11.781200 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d26cf4f9-6917-40f4-8669-7ac0c9508cb0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:11.798515 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=100 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:11.927025 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-db79fb04-980a-46e3-a9a7-ee5f4b65c718 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:11.935805 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-db79fb04-980a-46e3-a9a7-ee5f4b65c718 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:11.937400 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-db79fb04-980a-46e3-a9a7-ee5f4b65c718 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:11.938590 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-db79fb04-980a-46e3-a9a7-ee5f4b65c718 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1406 microversion: 2.20 time: 0.213574 Jul 01 16:41:11.939177 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 49/97] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:41:11 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:41:11.944547 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9391fc25-1672-4b79-90d1-1270043e7bf3 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:11.945155 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9391fc25-1672-4b79-90d1-1270043e7bf3 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:11.951545 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9391fc25-1672-4b79-90d1-1270043e7bf3 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:11.952087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9391fc25-1672-4b79-90d1-1270043e7bf3 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:11.952940 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9391fc25-1672-4b79-90d1-1270043e7bf3 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:11.953567 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9391fc25-1672-4b79-90d1-1270043e7bf3 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:11.972407 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d26cf4f9-6917-40f4-8669-7ac0c9508cb0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:11.980021 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d26cf4f9-6917-40f4-8669-7ac0c9508cb0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1321 microversion: 2.1 time: 0.213337 Jul 01 16:41:11.980892 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 49/98] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:11 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:41:12.103558 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9391fc25-1672-4b79-90d1-1270043e7bf3 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:12.112153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9391fc25-1672-4b79-90d1-1270043e7bf3 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1313 microversion: 2.1 time: 0.171177 Jul 01 16:41:12.112943 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 50/99] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:11 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:12.223379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5181b47a-8e6d-4ed5-95c0-308e2939cc95 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:12.223931 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5181b47a-8e6d-4ed5-95c0-308e2939cc95 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:12.229918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5181b47a-8e6d-4ed5-95c0-308e2939cc95 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:12.230391 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5181b47a-8e6d-4ed5-95c0-308e2939cc95 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:12.231155 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5181b47a-8e6d-4ed5-95c0-308e2939cc95 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:12.231592 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5181b47a-8e6d-4ed5-95c0-308e2939cc95 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:12.364158 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5181b47a-8e6d-4ed5-95c0-308e2939cc95 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:12.371709 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5181b47a-8e6d-4ed5-95c0-308e2939cc95 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1367 microversion: 2.1 time: 0.153272 Jul 01 16:41:12.372280 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 50/100] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:12 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:12.958227 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c40a5506-3c6c-475d-ad5b-6ad31b9fa326 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:12.958874 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c40a5506-3c6c-475d-ad5b-6ad31b9fa326 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:12.965256 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c40a5506-3c6c-475d-ad5b-6ad31b9fa326 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:12.965706 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c40a5506-3c6c-475d-ad5b-6ad31b9fa326 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:12.966499 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c40a5506-3c6c-475d-ad5b-6ad31b9fa326 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:12.966942 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c40a5506-3c6c-475d-ad5b-6ad31b9fa326 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:12.996798 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ee5bc34a-a63d-44e9-bbd6-467a075c0438 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:12.997405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ee5bc34a-a63d-44e9-bbd6-467a075c0438 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:13.004627 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ee5bc34a-a63d-44e9-bbd6-467a075c0438 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:13.005084 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ee5bc34a-a63d-44e9-bbd6-467a075c0438 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:13.005843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ee5bc34a-a63d-44e9-bbd6-467a075c0438 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:13.006316 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ee5bc34a-a63d-44e9-bbd6-467a075c0438 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:13.147324 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c40a5506-3c6c-475d-ad5b-6ad31b9fa326 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:13.156206 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c40a5506-3c6c-475d-ad5b-6ad31b9fa326 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:13.157914 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c40a5506-3c6c-475d-ad5b-6ad31b9fa326 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:13.159270 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c40a5506-3c6c-475d-ad5b-6ad31b9fa326 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1406 microversion: 2.20 time: 0.205443 Jul 01 16:41:13.160214 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 51/101] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:41:12 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:41:13.164959 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c9f74d36-dc1c-4c9e-a87c-712e06d0ade0 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:13.165748 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c9f74d36-dc1c-4c9e-a87c-712e06d0ade0 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:13.171999 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c9f74d36-dc1c-4c9e-a87c-712e06d0ade0 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:13.172466 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c9f74d36-dc1c-4c9e-a87c-712e06d0ade0 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:13.173287 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c9f74d36-dc1c-4c9e-a87c-712e06d0ade0 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:13.174009 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c9f74d36-dc1c-4c9e-a87c-712e06d0ade0 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:13.194360 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ee5bc34a-a63d-44e9-bbd6-467a075c0438 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:13.201901 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ee5bc34a-a63d-44e9-bbd6-467a075c0438 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1321 microversion: 2.1 time: 0.208819 Jul 01 16:41:13.202717 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 51/102] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:12 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:41:13.308360 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c9f74d36-dc1c-4c9e-a87c-712e06d0ade0 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:13.316363 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c9f74d36-dc1c-4c9e-a87c-712e06d0ade0 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1313 microversion: 2.1 time: 0.154916 Jul 01 16:41:13.316938 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 52/103] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:13 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:13.388478 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-95579831-b526-483a-8afd-7ad0565769bb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:13.389007 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-95579831-b526-483a-8afd-7ad0565769bb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:13.395722 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-95579831-b526-483a-8afd-7ad0565769bb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:13.396164 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-95579831-b526-483a-8afd-7ad0565769bb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:13.396947 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-95579831-b526-483a-8afd-7ad0565769bb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:13.397377 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-95579831-b526-483a-8afd-7ad0565769bb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:13.524146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-95579831-b526-483a-8afd-7ad0565769bb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:13.531660 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-95579831-b526-483a-8afd-7ad0565769bb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1367 microversion: 2.1 time: 0.147113 Jul 01 16:41:13.532229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 52/104] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:13 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:14.177762 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d99d2c4e-c731-4788-b5f6-0bdb5fdc874d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:14.178385 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d99d2c4e-c731-4788-b5f6-0bdb5fdc874d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:14.184463 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d99d2c4e-c731-4788-b5f6-0bdb5fdc874d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:14.184910 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d99d2c4e-c731-4788-b5f6-0bdb5fdc874d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:14.185666 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d99d2c4e-c731-4788-b5f6-0bdb5fdc874d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:14.186100 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d99d2c4e-c731-4788-b5f6-0bdb5fdc874d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:14.220004 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a0080e47-75e3-4b36-9059-cc9572c8bf96 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:14.220902 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a0080e47-75e3-4b36-9059-cc9572c8bf96 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:14.227849 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a0080e47-75e3-4b36-9059-cc9572c8bf96 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:14.228460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a0080e47-75e3-4b36-9059-cc9572c8bf96 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:14.233573 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a0080e47-75e3-4b36-9059-cc9572c8bf96 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:14.234106 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a0080e47-75e3-4b36-9059-cc9572c8bf96 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:14.389940 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d99d2c4e-c731-4788-b5f6-0bdb5fdc874d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:14.398392 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d99d2c4e-c731-4788-b5f6-0bdb5fdc874d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:14.399887 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d99d2c4e-c731-4788-b5f6-0bdb5fdc874d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:14.400986 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d99d2c4e-c731-4788-b5f6-0bdb5fdc874d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1406 microversion: 2.20 time: 0.227798 Jul 01 16:41:14.401734 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 53/105] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:41:14 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:41:14.405951 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-32396662-94fc-4b79-b538-1e8bb9a7df21 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:14.406589 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-32396662-94fc-4b79-b538-1e8bb9a7df21 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:14.413001 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-32396662-94fc-4b79-b538-1e8bb9a7df21 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:14.413445 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-32396662-94fc-4b79-b538-1e8bb9a7df21 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:14.414201 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-32396662-94fc-4b79-b538-1e8bb9a7df21 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:14.414663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-32396662-94fc-4b79-b538-1e8bb9a7df21 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:14.417725 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a0080e47-75e3-4b36-9059-cc9572c8bf96 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:14.426449 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a0080e47-75e3-4b36-9059-cc9572c8bf96 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1321 microversion: 2.1 time: 0.210204 Jul 01 16:41:14.427242 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 53/106] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:14 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:14.550033 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4c6c39d5-222b-4e7f-b067-d860f975a629 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:14.550872 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4c6c39d5-222b-4e7f-b067-d860f975a629 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:14.557232 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4c6c39d5-222b-4e7f-b067-d860f975a629 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:14.557684 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4c6c39d5-222b-4e7f-b067-d860f975a629 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:14.558491 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4c6c39d5-222b-4e7f-b067-d860f975a629 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:14.558927 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4c6c39d5-222b-4e7f-b067-d860f975a629 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:14.567307 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-32396662-94fc-4b79-b538-1e8bb9a7df21 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:14.590244 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-32396662-94fc-4b79-b538-1e8bb9a7df21 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1313 microversion: 2.1 time: 0.186717 Jul 01 16:41:14.591658 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 54/107] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:14 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:14.712590 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4c6c39d5-222b-4e7f-b067-d860f975a629 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:14.721795 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4c6c39d5-222b-4e7f-b067-d860f975a629 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1367 microversion: 2.1 time: 0.175445 Jul 01 16:41:14.722595 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 54/108] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:14 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:41:15.419383 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d512a47d-9079-4b95-b012-8a4849e6dfeb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:15.420052 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d512a47d-9079-4b95-b012-8a4849e6dfeb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:15.428383 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d512a47d-9079-4b95-b012-8a4849e6dfeb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:15.429323 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d512a47d-9079-4b95-b012-8a4849e6dfeb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:15.430639 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d512a47d-9079-4b95-b012-8a4849e6dfeb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:15.431387 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d512a47d-9079-4b95-b012-8a4849e6dfeb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:15.446068 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-95512cc0-7879-4548-85e7-7bf1c53269ae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:15.446912 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-95512cc0-7879-4548-85e7-7bf1c53269ae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:15.461131 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-95512cc0-7879-4548-85e7-7bf1c53269ae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:15.461970 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-95512cc0-7879-4548-85e7-7bf1c53269ae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:15.463094 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-95512cc0-7879-4548-85e7-7bf1c53269ae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:15.463917 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-95512cc0-7879-4548-85e7-7bf1c53269ae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:15.803467 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d512a47d-9079-4b95-b012-8a4849e6dfeb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:15.810023 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-95512cc0-7879-4548-85e7-7bf1c53269ae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:15.811640 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d512a47d-9079-4b95-b012-8a4849e6dfeb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:15.813151 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d512a47d-9079-4b95-b012-8a4849e6dfeb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:15.814910 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d512a47d-9079-4b95-b012-8a4849e6dfeb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1406 microversion: 2.20 time: 0.400165 Jul 01 16:41:15.815142 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 55/109] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:41:15 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1406 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:41:15.820168 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-066184a6-5ad9-428e-bb7a-f8dada97742a tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:15.820950 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-066184a6-5ad9-428e-bb7a-f8dada97742a tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:15.821741 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-95512cc0-7879-4548-85e7-7bf1c53269ae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1321 microversion: 2.1 time: 0.379022 Jul 01 16:41:15.822324 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 55/110] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:15 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1321 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:41:15.832016 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b7be37d0-d32f-4006-bbcc-1146cbeac3b0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:15.835130 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b7be37d0-d32f-4006-bbcc-1146cbeac3b0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:15.837968 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-066184a6-5ad9-428e-bb7a-f8dada97742a tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:15.838662 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-066184a6-5ad9-428e-bb7a-f8dada97742a tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:15.840230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-066184a6-5ad9-428e-bb7a-f8dada97742a tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:15.840841 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-066184a6-5ad9-428e-bb7a-f8dada97742a tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:15.843483 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b7be37d0-d32f-4006-bbcc-1146cbeac3b0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:15.844659 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b7be37d0-d32f-4006-bbcc-1146cbeac3b0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:15.846332 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b7be37d0-d32f-4006-bbcc-1146cbeac3b0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:15.848414 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b7be37d0-d32f-4006-bbcc-1146cbeac3b0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:16.130982 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b7be37d0-d32f-4006-bbcc-1146cbeac3b0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:16.142163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b7be37d0-d32f-4006-bbcc-1146cbeac3b0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1558 microversion: 2.1 time: 0.318201 Jul 01 16:41:16.144596 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 56/111] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:15 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1558 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:16.151668 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-0a6dc84f-6064-4e15-800d-d882b3744041 req-d6960b82-b28b-4f32-a6c1-667cbc2ca14b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8498c0a8-d20e-4261-a0a1-d4c33004141c", "name": "network-vif-plugged", "status": "completed", "tag": "2c1b8fc6-0b53-4c5c-83ee-2d68d226acfa"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:41:16.157058 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-066184a6-5ad9-428e-bb7a-f8dada97742a tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:16.164316 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-0a6dc84f-6064-4e15-800d-d882b3744041 req-d6960b82-b28b-4f32-a6c1-667cbc2ca14b service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:16.165054 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-0a6dc84f-6064-4e15-800d-d882b3744041 req-d6960b82-b28b-4f32-a6c1-667cbc2ca14b service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:16.170592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-066184a6-5ad9-428e-bb7a-f8dada97742a tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1499 microversion: 2.1 time: 0.352637 Jul 01 16:41:16.171198 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 56/112] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:15 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1499 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:16.192314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8f0c9813-b1e2-49ba-97ed-3c90a12ffbf8 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:16.192521 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-0a6dc84f-6064-4e15-800d-d882b3744041 req-d6960b82-b28b-4f32-a6c1-667cbc2ca14b service nova] Creating event network-vif-plugged:2c1b8fc6-0b53-4c5c-83ee-2d68d226acfa for instance 8498c0a8-d20e-4261-a0a1-d4c33004141c on hv-cinder-79760 Jul 01 16:41:16.192852 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8f0c9813-b1e2-49ba-97ed-3c90a12ffbf8 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:16.198739 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-0a6dc84f-6064-4e15-800d-d882b3744041 req-d6960b82-b28b-4f32-a6c1-667cbc2ca14b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051265 Jul 01 16:41:16.200208 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 57/113] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:41:16.215855 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8f0c9813-b1e2-49ba-97ed-3c90a12ffbf8 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:16.216787 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8f0c9813-b1e2-49ba-97ed-3c90a12ffbf8 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:16.218672 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8f0c9813-b1e2-49ba-97ed-3c90a12ffbf8 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:16.219436 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8f0c9813-b1e2-49ba-97ed-3c90a12ffbf8 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:16.403786 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8f0c9813-b1e2-49ba-97ed-3c90a12ffbf8 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.231183 Jul 01 16:41:16.404970 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 57/114] 10.222.0.57 () {58 vars in 1274 bytes} [Fri Jul 1 16:41:16 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e/os-interface => generated 285 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:41:16.834942 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-88cc8b0a-8927-4849-b4e8-41152223f6eb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:16.834942 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-88cc8b0a-8927-4849-b4e8-41152223f6eb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:16.843540 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-07296fa1-a73d-4a72-83a6-34e1201a8845 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:16.844087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-07296fa1-a73d-4a72-83a6-34e1201a8845 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:16.856523 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-07296fa1-a73d-4a72-83a6-34e1201a8845 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:16.856977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-07296fa1-a73d-4a72-83a6-34e1201a8845 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:16.857764 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-07296fa1-a73d-4a72-83a6-34e1201a8845 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:16.858206 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-07296fa1-a73d-4a72-83a6-34e1201a8845 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:16.890363 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-88cc8b0a-8927-4849-b4e8-41152223f6eb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:16.890826 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-88cc8b0a-8927-4849-b4e8-41152223f6eb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:16.891612 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-88cc8b0a-8927-4849-b4e8-41152223f6eb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:16.903575 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-88cc8b0a-8927-4849-b4e8-41152223f6eb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:17.316175 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-88cc8b0a-8927-4849-b4e8-41152223f6eb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:17.340564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-07296fa1-a73d-4a72-83a6-34e1201a8845 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:17.352532 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-07296fa1-a73d-4a72-83a6-34e1201a8845 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1321 microversion: 2.1 time: 0.511707 Jul 01 16:41:17.353014 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-88cc8b0a-8927-4849-b4e8-41152223f6eb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:17.361984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 58/115] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:16 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1321 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:17.362177 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-88cc8b0a-8927-4849-b4e8-41152223f6eb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:17.362177 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-88cc8b0a-8927-4849-b4e8-41152223f6eb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1406 microversion: 2.20 time: 0.534426 Jul 01 16:41:17.374573 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 58/116] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:41:16 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1406 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:41:18.041196 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-de81efe1-fb84-46ea-9bb7-d5d4e5d40782 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf4b1460-1ee8-45a6-b1e7-402690d1f579"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:41:18.042316 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-de81efe1-fb84-46ea-9bb7-d5d4e5d40782 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:18.048592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-de81efe1-fb84-46ea-9bb7-d5d4e5d40782 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:18.049043 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-de81efe1-fb84-46ea-9bb7-d5d4e5d40782 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:18.049909 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-de81efe1-fb84-46ea-9bb7-d5d4e5d40782 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:18.050361 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-de81efe1-fb84-46ea-9bb7-d5d4e5d40782 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:18.232721 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-886da775-2a82-49d2-a2ae-fe542ac647a1 req-dd979d6d-35cf-4c3b-af0f-b8c56a30db78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdb792a6-440e-4a96-89d8-3b65ee1a5a2e", "tag": "0d85f90c-e016-4950-ba0b-5986f1ed198f"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:41:18.241747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-886da775-2a82-49d2-a2ae-fe542ac647a1 req-dd979d6d-35cf-4c3b-af0f-b8c56a30db78 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:18.242432 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-886da775-2a82-49d2-a2ae-fe542ac647a1 req-dd979d6d-35cf-4c3b-af0f-b8c56a30db78 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:18.276412 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-886da775-2a82-49d2-a2ae-fe542ac647a1 req-dd979d6d-35cf-4c3b-af0f-b8c56a30db78 service nova] Creating event network-changed:0d85f90c-e016-4950-ba0b-5986f1ed198f for instance bdb792a6-440e-4a96-89d8-3b65ee1a5a2e on hv-cinder-79760 Jul 01 16:41:18.284008 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-886da775-2a82-49d2-a2ae-fe542ac647a1 req-dd979d6d-35cf-4c3b-af0f-b8c56a30db78 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055934 Jul 01 16:41:18.287710 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 59/117] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:41:18.303634 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-77949144-5588-4686-87bb-185526149417 req-075b680e-505d-4c34-9016-4a8900e000f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccdab81c-96e6-4936-8bd6-fe8a3ea5e956", "name": "network-vif-plugged", "status": "completed", "tag": "6734072e-1ee7-4702-af2c-30d3cd1f8189"}, {"server_uuid": "a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5", "name": "network-vif-plugged", "status": "completed", "tag": "bdfbafea-3e39-44d2-9b40-9668e19b3334"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:41:18.334942 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-77949144-5588-4686-87bb-185526149417 req-075b680e-505d-4c34-9016-4a8900e000f5 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:18.335645 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-77949144-5588-4686-87bb-185526149417 req-075b680e-505d-4c34-9016-4a8900e000f5 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:18.350989 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-77949144-5588-4686-87bb-185526149417 req-075b680e-505d-4c34-9016-4a8900e000f5 service nova] Creating event network-vif-plugged:6734072e-1ee7-4702-af2c-30d3cd1f8189 for instance ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 on hv-cinder-79760 Jul 01 16:41:18.351682 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-77949144-5588-4686-87bb-185526149417 req-075b680e-505d-4c34-9016-4a8900e000f5 service nova] Creating event network-vif-plugged:bdfbafea-3e39-44d2-9b40-9668e19b3334 for instance a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 on hv-cinder-79760 Jul 01 16:41:18.359047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-77949144-5588-4686-87bb-185526149417 req-075b680e-505d-4c34-9016-4a8900e000f5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067440 Jul 01 16:41:18.360464 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 60/118] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:41:18.370185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-bbbffcaa-2fbd-4c5b-b878-b32aa205c941 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:18.371308 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-bbbffcaa-2fbd-4c5b-b878-b32aa205c941 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:18.380541 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bbbffcaa-2fbd-4c5b-b878-b32aa205c941 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:18.381836 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bbbffcaa-2fbd-4c5b-b878-b32aa205c941 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:18.383029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bbbffcaa-2fbd-4c5b-b878-b32aa205c941 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:18.383629 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bbbffcaa-2fbd-4c5b-b878-b32aa205c941 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:18.602850 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bbbffcaa-2fbd-4c5b-b878-b32aa205c941 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:18.612414 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-bbbffcaa-2fbd-4c5b-b878-b32aa205c941 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1321 microversion: 2.1 time: 0.246302 Jul 01 16:41:18.618426 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 61/119] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:18 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:18.631099 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d608648a-f476-440d-8d1e-4384e92b7203 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:18.636277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d608648a-f476-440d-8d1e-4384e92b7203 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:18.654034 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d608648a-f476-440d-8d1e-4384e92b7203 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:18.654307 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d608648a-f476-440d-8d1e-4384e92b7203 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:18.655106 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d608648a-f476-440d-8d1e-4384e92b7203 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:18.655540 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d608648a-f476-440d-8d1e-4384e92b7203 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:18.925329 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d608648a-f476-440d-8d1e-4384e92b7203 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:18.936597 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d608648a-f476-440d-8d1e-4384e92b7203 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:18.941540 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d608648a-f476-440d-8d1e-4384e92b7203 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:18.943344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d608648a-f476-440d-8d1e-4384e92b7203 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1597 microversion: 2.20 time: 0.329109 Jul 01 16:41:18.944942 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 62/120] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:41:18 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1597 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:41:18.968645 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c7be89b4-8f22-4e1d-9490-eb105d8500a5 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:18.969134 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c7be89b4-8f22-4e1d-9490-eb105d8500a5 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:18.977363 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c7be89b4-8f22-4e1d-9490-eb105d8500a5 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:18.978040 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c7be89b4-8f22-4e1d-9490-eb105d8500a5 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:18.979409 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c7be89b4-8f22-4e1d-9490-eb105d8500a5 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:18.980051 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c7be89b4-8f22-4e1d-9490-eb105d8500a5 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:19.002104 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-de81efe1-fb84-46ea-9bb7-d5d4e5d40782 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "POST /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.963731 Jul 01 16:41:19.025122 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 59/121] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 1 16:41:18 2022] POST /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19/os-volume_attachments => generated 194 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:41:19.332074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c7be89b4-8f22-4e1d-9490-eb105d8500a5 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.370272 Jul 01 16:41:19.333421 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 63/122] 10.222.0.57 () {60 vars in 1315 bytes} [Fri Jul 1 16:41:18 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c/os-interface => generated 284 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 16:41:19.634652 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3a8fd8d3-857a-4959-88ce-e00ed359e78c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:19.636244 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3a8fd8d3-857a-4959-88ce-e00ed359e78c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:19.656497 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3a8fd8d3-857a-4959-88ce-e00ed359e78c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:19.659542 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3a8fd8d3-857a-4959-88ce-e00ed359e78c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:19.660958 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3a8fd8d3-857a-4959-88ce-e00ed359e78c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:19.662813 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3a8fd8d3-857a-4959-88ce-e00ed359e78c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:20.414368 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3a8fd8d3-857a-4959-88ce-e00ed359e78c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:20.429267 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3a8fd8d3-857a-4959-88ce-e00ed359e78c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1321 microversion: 2.1 time: 0.802705 Jul 01 16:41:20.429957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 60/123] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:19 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1321 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:21.455975 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-115250f6-5a69-404f-8935-6840b739e6ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:21.458640 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-115250f6-5a69-404f-8935-6840b739e6ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:21.468395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-115250f6-5a69-404f-8935-6840b739e6ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:21.468848 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-115250f6-5a69-404f-8935-6840b739e6ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:21.471121 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-115250f6-5a69-404f-8935-6840b739e6ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:21.471576 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-115250f6-5a69-404f-8935-6840b739e6ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:21.712890 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-115250f6-5a69-404f-8935-6840b739e6ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:21.727433 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-115250f6-5a69-404f-8935-6840b739e6ef tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1321 microversion: 2.1 time: 0.281963 Jul 01 16:41:21.734872 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 64/124] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:21 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:21.800958 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-3ec41d48-c403-4cfd-960a-3cb048cb4e99 req-c74da62f-38a1-4ce1-b865-2fc7fc073c88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8498c0a8-d20e-4261-a0a1-d4c33004141c", "tag": "2c1b8fc6-0b53-4c5c-83ee-2d68d226acfa"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:41:21.814672 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-3ec41d48-c403-4cfd-960a-3cb048cb4e99 req-c74da62f-38a1-4ce1-b865-2fc7fc073c88 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:21.815178 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-3ec41d48-c403-4cfd-960a-3cb048cb4e99 req-c74da62f-38a1-4ce1-b865-2fc7fc073c88 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:21.843982 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-3ec41d48-c403-4cfd-960a-3cb048cb4e99 req-c74da62f-38a1-4ce1-b865-2fc7fc073c88 service nova] Creating event network-changed:2c1b8fc6-0b53-4c5c-83ee-2d68d226acfa for instance 8498c0a8-d20e-4261-a0a1-d4c33004141c on hv-cinder-79760 Jul 01 16:41:21.849561 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-3ec41d48-c403-4cfd-960a-3cb048cb4e99 req-c74da62f-38a1-4ce1-b865-2fc7fc073c88 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053273 Jul 01 16:41:21.850828 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 61/125] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:41:22.747141 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5124b4e1-1286-40f6-88ac-6ccb02a28222 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:22.748355 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5124b4e1-1286-40f6-88ac-6ccb02a28222 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:22.755123 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5124b4e1-1286-40f6-88ac-6ccb02a28222 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:22.755885 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5124b4e1-1286-40f6-88ac-6ccb02a28222 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:22.756965 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5124b4e1-1286-40f6-88ac-6ccb02a28222 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:22.757676 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5124b4e1-1286-40f6-88ac-6ccb02a28222 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:22.936955 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5124b4e1-1286-40f6-88ac-6ccb02a28222 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:22.945546 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5124b4e1-1286-40f6-88ac-6ccb02a28222 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1321 microversion: 2.1 time: 0.202344 Jul 01 16:41:22.946250 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 65/126] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:22 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:23.964598 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-75a0f68e-2e6b-4d61-a2f8-ca8d812c94bc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:23.965297 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-75a0f68e-2e6b-4d61-a2f8-ca8d812c94bc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:23.973283 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-75a0f68e-2e6b-4d61-a2f8-ca8d812c94bc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:23.973766 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-75a0f68e-2e6b-4d61-a2f8-ca8d812c94bc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:23.974743 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-75a0f68e-2e6b-4d61-a2f8-ca8d812c94bc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:23.975273 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-75a0f68e-2e6b-4d61-a2f8-ca8d812c94bc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:24.122041 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-75a0f68e-2e6b-4d61-a2f8-ca8d812c94bc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:24.130221 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-75a0f68e-2e6b-4d61-a2f8-ca8d812c94bc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1321 microversion: 2.1 time: 0.170564 Jul 01 16:41:24.130838 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 62/127] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:23 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:25.148320 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-648e5619-6985-4ab8-bb54-fac272ca21a2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:25.149275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-648e5619-6985-4ab8-bb54-fac272ca21a2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:25.156581 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-648e5619-6985-4ab8-bb54-fac272ca21a2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:25.157207 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-648e5619-6985-4ab8-bb54-fac272ca21a2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:25.158974 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-648e5619-6985-4ab8-bb54-fac272ca21a2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:25.159416 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-648e5619-6985-4ab8-bb54-fac272ca21a2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:25.319769 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-648e5619-6985-4ab8-bb54-fac272ca21a2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:25.327652 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-648e5619-6985-4ab8-bb54-fac272ca21a2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1321 microversion: 2.1 time: 0.184186 Jul 01 16:41:25.328394 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 66/128] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:25 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:41:26.347011 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e47544e8-eee9-4726-becd-ad8d8bf5ae7d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:26.348923 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e47544e8-eee9-4726-becd-ad8d8bf5ae7d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:26.357408 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e47544e8-eee9-4726-becd-ad8d8bf5ae7d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:26.358039 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e47544e8-eee9-4726-becd-ad8d8bf5ae7d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:26.358955 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e47544e8-eee9-4726-becd-ad8d8bf5ae7d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:26.359598 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e47544e8-eee9-4726-becd-ad8d8bf5ae7d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:26.581718 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e47544e8-eee9-4726-becd-ad8d8bf5ae7d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:26.597513 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e47544e8-eee9-4726-becd-ad8d8bf5ae7d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1515 microversion: 2.1 time: 0.255275 Jul 01 16:41:26.599618 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 63/129] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:26 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1515 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:26.618037 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-824903be-173d-4ee3-9856-dc7e1be5db07 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:41:26.619850 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-824903be-173d-4ee3-9856-dc7e1be5db07 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:26.628340 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-824903be-173d-4ee3-9856-dc7e1be5db07 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:26.628978 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-824903be-173d-4ee3-9856-dc7e1be5db07 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:26.629924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-824903be-173d-4ee3-9856-dc7e1be5db07 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:26.630568 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-824903be-173d-4ee3-9856-dc7e1be5db07 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:26.682547 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-824903be-173d-4ee3-9856-dc7e1be5db07 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lazy-loading 'flavor' on Instance uuid a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:41:26.753519 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=100 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:26.817805 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-824903be-173d-4ee3-9856-dc7e1be5db07 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "POST /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5/action" status: 200 len: 32 microversion: 2.1 time: 0.204937 Jul 01 16:41:26.818771 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 67/130] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 1 16:41:26 2022] POST /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5/action => generated 32 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 16:41:26.827530 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e1702949-5515-49ae-b02d-f76bc853b3bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:26.828493 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e1702949-5515-49ae-b02d-f76bc853b3bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:26.852854 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e1702949-5515-49ae-b02d-f76bc853b3bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:26.855167 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e1702949-5515-49ae-b02d-f76bc853b3bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:26.856772 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e1702949-5515-49ae-b02d-f76bc853b3bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:26.857238 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e1702949-5515-49ae-b02d-f76bc853b3bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:27.279625 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e1702949-5515-49ae-b02d-f76bc853b3bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:27.288803 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e1702949-5515-49ae-b02d-f76bc853b3bf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.465253 Jul 01 16:41:27.292171 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 64/131] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:26 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:41:28.310872 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-91aae8d0-bbe1-4471-801d-aae47783c321 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:28.311738 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-91aae8d0-bbe1-4471-801d-aae47783c321 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:28.315795 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=81 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:28.328437 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-91aae8d0-bbe1-4471-801d-aae47783c321 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:28.330273 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-91aae8d0-bbe1-4471-801d-aae47783c321 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:28.337824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-91aae8d0-bbe1-4471-801d-aae47783c321 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:28.338514 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-91aae8d0-bbe1-4471-801d-aae47783c321 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:28.635269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-91aae8d0-bbe1-4471-801d-aae47783c321 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:28.647868 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-91aae8d0-bbe1-4471-801d-aae47783c321 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.341776 Jul 01 16:41:28.650586 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 68/132] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:28 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:41:29.667212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-60f15c09-2a35-470b-8903-ab6680798c26 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:29.667764 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-60f15c09-2a35-470b-8903-ab6680798c26 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:29.677527 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-60f15c09-2a35-470b-8903-ab6680798c26 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:29.678312 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-60f15c09-2a35-470b-8903-ab6680798c26 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:29.678835 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-60f15c09-2a35-470b-8903-ab6680798c26 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:29.679273 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-60f15c09-2a35-470b-8903-ab6680798c26 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:29.957859 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-60f15c09-2a35-470b-8903-ab6680798c26 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:29.961667 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:29.978030 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-60f15c09-2a35-470b-8903-ab6680798c26 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.314610 Jul 01 16:41:29.979310 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 65/133] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:29 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:30.998200 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-bbad2533-7740-4ca9-8dc9-50a9ea266e0f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:30.999026 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-bbad2533-7740-4ca9-8dc9-50a9ea266e0f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:31.009830 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bbad2533-7740-4ca9-8dc9-50a9ea266e0f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:31.010296 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bbad2533-7740-4ca9-8dc9-50a9ea266e0f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:31.011973 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bbad2533-7740-4ca9-8dc9-50a9ea266e0f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:31.014676 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bbad2533-7740-4ca9-8dc9-50a9ea266e0f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:31.232916 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bbad2533-7740-4ca9-8dc9-50a9ea266e0f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:31.245909 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-bbad2533-7740-4ca9-8dc9-50a9ea266e0f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.251669 Jul 01 16:41:31.248140 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 69/134] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:30 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:32.267562 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-28585f29-33bd-47dc-b68d-5da9d86ecbfa tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:32.268658 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-28585f29-33bd-47dc-b68d-5da9d86ecbfa tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:32.287972 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-28585f29-33bd-47dc-b68d-5da9d86ecbfa tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:32.288498 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-28585f29-33bd-47dc-b68d-5da9d86ecbfa tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:32.289289 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-28585f29-33bd-47dc-b68d-5da9d86ecbfa tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:32.290385 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-28585f29-33bd-47dc-b68d-5da9d86ecbfa tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:32.522857 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-28585f29-33bd-47dc-b68d-5da9d86ecbfa tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:32.531200 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-28585f29-33bd-47dc-b68d-5da9d86ecbfa tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.269967 Jul 01 16:41:32.532341 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 66/135] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:32 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:33.551353 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-653e5db6-1fc3-48d8-bfba-f0b0a45c1173 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:33.552067 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-653e5db6-1fc3-48d8-bfba-f0b0a45c1173 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:33.565870 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-653e5db6-1fc3-48d8-bfba-f0b0a45c1173 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:33.566318 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-653e5db6-1fc3-48d8-bfba-f0b0a45c1173 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:33.568315 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-653e5db6-1fc3-48d8-bfba-f0b0a45c1173 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:33.568750 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-653e5db6-1fc3-48d8-bfba-f0b0a45c1173 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:33.873670 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-aa3a1dd5-93ab-4a17-9619-322fb33fc36c tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:33.874336 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-aa3a1dd5-93ab-4a17-9619-322fb33fc36c tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:33.886027 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-aa3a1dd5-93ab-4a17-9619-322fb33fc36c tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:33.886518 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-aa3a1dd5-93ab-4a17-9619-322fb33fc36c tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:33.887301 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-aa3a1dd5-93ab-4a17-9619-322fb33fc36c tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:33.887739 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-aa3a1dd5-93ab-4a17-9619-322fb33fc36c tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:33.992073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-aa3a1dd5-93ab-4a17-9619-322fb33fc36c tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 16:41:34.130624 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-653e5db6-1fc3-48d8-bfba-f0b0a45c1173 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:34.142207 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-653e5db6-1fc3-48d8-bfba-f0b0a45c1173 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.597891 Jul 01 16:41:34.146220 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 70/136] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:33 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:34.172035 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-aa3a1dd5-93ab-4a17-9619-322fb33fc36c tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 204 len: 0 microversion: 2.1 time: 0.302146 Jul 01 16:41:34.178695 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 67/137] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:41:33 2022] DELETE /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 16:41:34.185666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9fec7d2b-94e8-4db1-82cf-e7ef14ec00ff tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:34.186385 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-9fec7d2b-94e8-4db1-82cf-e7ef14ec00ff tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:34.199742 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9fec7d2b-94e8-4db1-82cf-e7ef14ec00ff tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:34.203150 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9fec7d2b-94e8-4db1-82cf-e7ef14ec00ff tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:34.203973 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9fec7d2b-94e8-4db1-82cf-e7ef14ec00ff tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:34.204546 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9fec7d2b-94e8-4db1-82cf-e7ef14ec00ff tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:34.555960 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9fec7d2b-94e8-4db1-82cf-e7ef14ec00ff tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:34.572268 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9fec7d2b-94e8-4db1-82cf-e7ef14ec00ff tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1551 microversion: 2.1 time: 0.392634 Jul 01 16:41:34.573981 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 71/138] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:34 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1551 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:41:35.167193 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b71d5f5e-bc05-4817-9a8c-833199966ab7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:35.170558 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b71d5f5e-bc05-4817-9a8c-833199966ab7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:35.183495 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:35.186468 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b71d5f5e-bc05-4817-9a8c-833199966ab7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:35.187212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b71d5f5e-bc05-4817-9a8c-833199966ab7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:35.188649 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b71d5f5e-bc05-4817-9a8c-833199966ab7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:35.189312 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b71d5f5e-bc05-4817-9a8c-833199966ab7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:35.593463 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-125428de-76c9-4d8d-b058-45a9e923056f tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:35.594323 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-125428de-76c9-4d8d-b058-45a9e923056f tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:35.619667 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-125428de-76c9-4d8d-b058-45a9e923056f tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:35.638586 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b71d5f5e-bc05-4817-9a8c-833199966ab7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:35.639836 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-125428de-76c9-4d8d-b058-45a9e923056f tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:35.641190 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-125428de-76c9-4d8d-b058-45a9e923056f tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:35.644678 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-125428de-76c9-4d8d-b058-45a9e923056f tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:35.649405 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b71d5f5e-bc05-4817-9a8c-833199966ab7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.487129 Jul 01 16:41:35.650201 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 68/139] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:35 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:36.105830 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-125428de-76c9-4d8d-b058-45a9e923056f tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:36.125346 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-125428de-76c9-4d8d-b058-45a9e923056f tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1551 microversion: 2.1 time: 0.537010 Jul 01 16:41:36.127580 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 72/140] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:35 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1551 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:41:36.666332 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a56a4665-eaf4-4c70-bac7-b468fb84c647 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:36.668073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a56a4665-eaf4-4c70-bac7-b468fb84c647 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:36.675744 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a56a4665-eaf4-4c70-bac7-b468fb84c647 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:36.686233 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a56a4665-eaf4-4c70-bac7-b468fb84c647 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:36.687388 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a56a4665-eaf4-4c70-bac7-b468fb84c647 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:36.689253 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a56a4665-eaf4-4c70-bac7-b468fb84c647 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:37.109557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a56a4665-eaf4-4c70-bac7-b468fb84c647 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:37.122940 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a56a4665-eaf4-4c70-bac7-b468fb84c647 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.460243 Jul 01 16:41:37.136659 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 69/141] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:36 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:37.145632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-91cef2ca-3beb-4d79-ae5a-2d20266d4fae tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:37.146417 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-91cef2ca-3beb-4d79-ae5a-2d20266d4fae tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:37.162992 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-91cef2ca-3beb-4d79-ae5a-2d20266d4fae tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:37.163811 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-91cef2ca-3beb-4d79-ae5a-2d20266d4fae tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:37.167441 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-91cef2ca-3beb-4d79-ae5a-2d20266d4fae tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:37.168131 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-91cef2ca-3beb-4d79-ae5a-2d20266d4fae tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:37.569865 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-61aebe6a-c852-4c5d-aa27-d87d43ab917b req-e77b89e7-0faa-4e2d-8c3f-39915bc63cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4f1396-f645-4238-850e-358ca184ad19", "name": "network-vif-deleted", "tag": "d9188aa7-e096-4650-812e-94b0a5c94fda"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:41:37.595516 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-61aebe6a-c852-4c5d-aa27-d87d43ab917b req-e77b89e7-0faa-4e2d-8c3f-39915bc63cf7 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:37.603994 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-61aebe6a-c852-4c5d-aa27-d87d43ab917b req-e77b89e7-0faa-4e2d-8c3f-39915bc63cf7 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:37.627848 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-61aebe6a-c852-4c5d-aa27-d87d43ab917b req-e77b89e7-0faa-4e2d-8c3f-39915bc63cf7 service nova] Creating event network-vif-deleted:d9188aa7-e096-4650-812e-94b0a5c94fda for instance 5a4f1396-f645-4238-850e-358ca184ad19 on hv-cinder-79760 Jul 01 16:41:37.640908 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-61aebe6a-c852-4c5d-aa27-d87d43ab917b req-e77b89e7-0faa-4e2d-8c3f-39915bc63cf7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075064 Jul 01 16:41:37.648309 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 70/142] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:41:37.734072 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-91cef2ca-3beb-4d79-ae5a-2d20266d4fae tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:37.751823 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-91cef2ca-3beb-4d79-ae5a-2d20266d4fae tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1551 microversion: 2.1 time: 0.606608 Jul 01 16:41:37.759002 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 73/143] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:37 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1551 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:38.143759 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b36b357d-a4a9-4094-afee-40ea9dd01c19 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:38.144620 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b36b357d-a4a9-4094-afee-40ea9dd01c19 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:38.167105 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b36b357d-a4a9-4094-afee-40ea9dd01c19 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:38.167616 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b36b357d-a4a9-4094-afee-40ea9dd01c19 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:38.170161 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b36b357d-a4a9-4094-afee-40ea9dd01c19 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:38.174480 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b36b357d-a4a9-4094-afee-40ea9dd01c19 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:38.470717 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b36b357d-a4a9-4094-afee-40ea9dd01c19 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:38.480690 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b36b357d-a4a9-4094-afee-40ea9dd01c19 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.343965 Jul 01 16:41:38.481267 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 71/144] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:38 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:41:38.771696 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ea3b75cd-4b37-43f3-9808-36e8877b233e tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:38.772297 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ea3b75cd-4b37-43f3-9808-36e8877b233e tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:38.780564 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ea3b75cd-4b37-43f3-9808-36e8877b233e tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:38.781007 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ea3b75cd-4b37-43f3-9808-36e8877b233e tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:38.788498 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ea3b75cd-4b37-43f3-9808-36e8877b233e tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:38.789134 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ea3b75cd-4b37-43f3-9808-36e8877b233e tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:38.894470 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ea3b75cd-4b37-43f3-9808-36e8877b233e tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:38.894920 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ea3b75cd-4b37-43f3-9808-36e8877b233e tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:38.895369 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-ea3b75cd-4b37-43f3-9808-36e8877b233e tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lazy-loading 'fault' on Instance uuid 5a4f1396-f645-4238-850e-358ca184ad19 {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:41:38.974225 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ea3b75cd-4b37-43f3-9808-36e8877b233e tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea27a708e2c84ccc905ae783524bd12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c49e143df7c4d059430b7dc5bffd475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:38.990189 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ea3b75cd-4b37-43f3-9808-36e8877b233e tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 200 len: 1303 microversion: 2.1 time: 0.222211 Jul 01 16:41:38.990820 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 74/145] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:38 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 1303 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:39.498299 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-798d4001-167d-4521-b742-94a76036dd5a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:39.499697 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-798d4001-167d-4521-b742-94a76036dd5a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:39.508473 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-798d4001-167d-4521-b742-94a76036dd5a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:39.509366 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-798d4001-167d-4521-b742-94a76036dd5a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:39.510251 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-798d4001-167d-4521-b742-94a76036dd5a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:39.510817 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-798d4001-167d-4521-b742-94a76036dd5a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:39.751754 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-798d4001-167d-4521-b742-94a76036dd5a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:39.759628 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-798d4001-167d-4521-b742-94a76036dd5a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.265098 Jul 01 16:41:39.765413 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 72/146] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:39 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:40.008187 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-38ba6991-cfdf-4ece-a5a3-7d59142dd2b2 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:40.008805 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-38ba6991-cfdf-4ece-a5a3-7d59142dd2b2 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:40.018259 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-38ba6991-cfdf-4ece-a5a3-7d59142dd2b2 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:40.018806 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-38ba6991-cfdf-4ece-a5a3-7d59142dd2b2 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:40.019525 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-38ba6991-cfdf-4ece-a5a3-7d59142dd2b2 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:40.019966 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-38ba6991-cfdf-4ece-a5a3-7d59142dd2b2 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:40.035627 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-38ba6991-cfdf-4ece-a5a3-7d59142dd2b2 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] HTTP exception thrown: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. Jul 01 16:41:40.055954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-38ba6991-cfdf-4ece-a5a3-7d59142dd2b2 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Request method failure captured: Jul 01 16:41:40.055954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 HTTP/1.1 Jul 01 16:41:40.055954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:41:40.055954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:41:40.055954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:41:40.055954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:41:40.055954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:41:40.055954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:41:40.055954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:41:40.055954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:41:40.055954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyOG0qgpaeh3UWlIApjA8wG4WmOBDycAmirO90h7464OCHQMOSsNI1KezqeHQjFpjtQn4Do0CRkDui_4VmjF4MtNdPeHWkHwCmr6FRjttu329l0mtebPEOMa5uQwGaWLVS0rW7Yi20_hbWIV_G8Y7pNF-xqRPiOzBogmcEdQm9GAMgE Jul 01 16:41:40.055954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:41:40.055954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:41:40.055954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:41:40.055954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:41:40.055954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:41:40.055954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:41:40.055954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: 2c49e143df7c4d059430b7dc5bffd475 Jul 01 16:41:40.055954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-DeleteServersTestJSON-1598392548 Jul 01 16:41:40.055954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:41:40.055954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:41:40.057205 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2c49e143df7c4d059430b7dc5bffd475"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2c49e143df7c4d059430b7dc5bffd475"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2c49e143df7c4d059430b7dc5bffd475"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2c49e143df7c4d059430b7dc5bffd475"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:41:40.057205 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-DeleteServersTestJSON-1598392548 Jul 01 16:41:40.057205 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 2c49e143df7c4d059430b7dc5bffd475 Jul 01 16:41:40.057205 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-DeleteServersTestJSON-1598392548 Jul 01 16:41:40.057205 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-DeleteServersTestJSON-1598392548-project Jul 01 16:41:40.057205 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:41:40.057205 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:41:40.057205 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: ea27a708e2c84ccc905ae783524bd12f Jul 01 16:41:40.057205 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-DeleteServersTestJSON-1598392548-project Jul 01 16:41:40.057205 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:41:40.057205 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. Jul 01 16:41:40.057205 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': '5a4f1396-f645-4238-850e-358ca184ad19'} Jul 01 16:41:40.057877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:41:40.057877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:41:40.057877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:41:40.057877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:41:40.057877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:41:40.057877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:41:40.057877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:41:40.057877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:41:40.057877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:41:40.057877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:41:40.057877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. Jul 01 16:41:40.057877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:41:40.057877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:41:40.057877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:41:40.057877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:41:40.057877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:41:40.057877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:41:40.057877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:41:40.057877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:41:40.057877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:41:40.059065 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:41:40.059065 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:41:40.059065 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:41:40.059065 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:41:40.059065 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:41:40.059065 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:41:40.059065 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:41:40.059065 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. Jul 01 16:41:40.059065 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:41:40.059065 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:41:40.059065 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:41:40.059065 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:41:40.059065 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:41:40.059065 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:41:40.059065 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:41:40.059065 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:41:40.059065 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. Jul 01 16:41:40.059065 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:41:40.060063 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-38ba6991-cfdf-4ece-a5a3-7d59142dd2b2 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Returning 404 to user: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:41:40.060063 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-38ba6991-cfdf-4ece-a5a3-7d59142dd2b2 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 404 len: 111 microversion: 2.1 time: 0.053360 Jul 01 16:41:40.060063 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 75/147] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:40 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:41:40.170449 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f82a70a8-5e3b-4955-839f-d82fafe9442b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:40.171771 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f82a70a8-5e3b-4955-839f-d82fafe9442b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:40.177887 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f82a70a8-5e3b-4955-839f-d82fafe9442b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:40.178335 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f82a70a8-5e3b-4955-839f-d82fafe9442b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:40.179147 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f82a70a8-5e3b-4955-839f-d82fafe9442b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:40.179579 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f82a70a8-5e3b-4955-839f-d82fafe9442b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:40.192617 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-f82a70a8-5e3b-4955-839f-d82fafe9442b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] HTTP exception thrown: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. Jul 01 16:41:40.200433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f82a70a8-5e3b-4955-839f-d82fafe9442b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Request method failure captured: Jul 01 16:41:40.200433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19/os-volume_attachments HTTP/1.1 Jul 01 16:41:40.200433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:41:40.200433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:41:40.200433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:41:40.200433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:41:40.200433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:41:40.200433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:41:40.200433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:41:40.200433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:41:40.200433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyOG0qgpaeh3UWlIApjA8wG4WmOBDycAmirO90h7464OCHQMOSsNI1KezqeHQjFpjtQn4Do0CRkDui_4VmjF4MtNdPeHWkHwCmr6FRjttu329l0mtebPEOMa5uQwGaWLVS0rW7Yi20_hbWIV_G8Y7pNF-xqRPiOzBogmcEdQm9GAMgE Jul 01 16:41:40.200433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:41:40.200433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:41:40.200433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:41:40.200433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:41:40.200433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:41:40.200433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:41:40.200433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: 2c49e143df7c4d059430b7dc5bffd475 Jul 01 16:41:40.200433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-DeleteServersTestJSON-1598392548 Jul 01 16:41:40.200433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:41:40.200433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:41:40.201744 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2c49e143df7c4d059430b7dc5bffd475"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2c49e143df7c4d059430b7dc5bffd475"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2c49e143df7c4d059430b7dc5bffd475"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2c49e143df7c4d059430b7dc5bffd475"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:41:40.201744 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-DeleteServersTestJSON-1598392548 Jul 01 16:41:40.201744 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 2c49e143df7c4d059430b7dc5bffd475 Jul 01 16:41:40.201744 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-DeleteServersTestJSON-1598392548 Jul 01 16:41:40.201744 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-DeleteServersTestJSON-1598392548-project Jul 01 16:41:40.201744 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:41:40.201744 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:41:40.201744 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: ea27a708e2c84ccc905ae783524bd12f Jul 01 16:41:40.201744 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-DeleteServersTestJSON-1598392548-project Jul 01 16:41:40.201744 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: > Jul 01 16:41:40.201744 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. Jul 01 16:41:40.201744 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'server_id': '5a4f1396-f645-4238-850e-358ca184ad19'} Jul 01 16:41:40.202433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:41:40.202433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:41:40.202433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:41:40.202433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:41:40.202433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:41:40.202433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:41:40.202433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:41:40.202433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:41:40.202433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:41:40.202433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:41:40.202433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. Jul 01 16:41:40.202433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:41:40.202433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:41:40.202433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:41:40.202433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:41:40.202433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:41:40.202433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:41:40.202433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:41:40.202433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:41:40.202433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:41:40.203496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:41:40.203496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 16:41:40.203496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 16:41:40.203496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 16:41:40.203496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 16:41:40.203496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 01 16:41:40.203496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 01 16:41:40.203496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:41:40.203496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:41:40.203496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. Jul 01 16:41:40.203496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:41:40.203496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:41:40.203496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:41:40.203496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:41:40.203496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:41:40.203496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:41:40.203496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:41:40.203496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:41:40.203496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. Jul 01 16:41:40.203496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:41:40.205149 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f82a70a8-5e3b-4955-839f-d82fafe9442b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Returning 404 to user: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:41:40.205149 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f82a70a8-5e3b-4955-839f-d82fafe9442b tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035483 Jul 01 16:41:40.205149 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 73/148] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 1 16:41:40 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:41:40.777383 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-476d5187-cdf6-4dca-8cee-346b25735183 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:40.778014 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-476d5187-cdf6-4dca-8cee-346b25735183 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:40.785984 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-476d5187-cdf6-4dca-8cee-346b25735183 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:40.786472 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-476d5187-cdf6-4dca-8cee-346b25735183 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:40.787262 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-476d5187-cdf6-4dca-8cee-346b25735183 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:40.787693 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-476d5187-cdf6-4dca-8cee-346b25735183 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:40.951294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-476d5187-cdf6-4dca-8cee-346b25735183 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:40.963819 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-476d5187-cdf6-4dca-8cee-346b25735183 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.190449 Jul 01 16:41:40.965095 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 76/149] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:40 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:41.981574 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2eb6a5c1-d0f6-4dd6-839b-7f18083672dc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:41.982288 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2eb6a5c1-d0f6-4dd6-839b-7f18083672dc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:41.993094 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2eb6a5c1-d0f6-4dd6-839b-7f18083672dc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:41.993914 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2eb6a5c1-d0f6-4dd6-839b-7f18083672dc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:41.994947 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2eb6a5c1-d0f6-4dd6-839b-7f18083672dc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:41.995604 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2eb6a5c1-d0f6-4dd6-839b-7f18083672dc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:42.170496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2eb6a5c1-d0f6-4dd6-839b-7f18083672dc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:42.182025 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2eb6a5c1-d0f6-4dd6-839b-7f18083672dc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.204311 Jul 01 16:41:42.182980 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 74/150] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:41 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:43.200281 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7d0d4c4b-5b52-4c67-bc52-63bbd1b04f40 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:43.202229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7d0d4c4b-5b52-4c67-bc52-63bbd1b04f40 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:43.215610 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7d0d4c4b-5b52-4c67-bc52-63bbd1b04f40 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:43.216900 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7d0d4c4b-5b52-4c67-bc52-63bbd1b04f40 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:43.218087 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7d0d4c4b-5b52-4c67-bc52-63bbd1b04f40 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:43.219332 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7d0d4c4b-5b52-4c67-bc52-63bbd1b04f40 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:43.405513 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7d0d4c4b-5b52-4c67-bc52-63bbd1b04f40 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:43.414179 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7d0d4c4b-5b52-4c67-bc52-63bbd1b04f40 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.218503 Jul 01 16:41:43.426616 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 77/151] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:43 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:43.617680 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-dec739cf-bf73-4e3c-9e3d-4160fecef7f1 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:43.618386 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-dec739cf-bf73-4e3c-9e3d-4160fecef7f1 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:43.625562 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dec739cf-bf73-4e3c-9e3d-4160fecef7f1 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:43.626130 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dec739cf-bf73-4e3c-9e3d-4160fecef7f1 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:43.626951 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dec739cf-bf73-4e3c-9e3d-4160fecef7f1 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:43.627393 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dec739cf-bf73-4e3c-9e3d-4160fecef7f1 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:43.663774 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-dec739cf-bf73-4e3c-9e3d-4160fecef7f1 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] HTTP exception thrown: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. Jul 01 16:41:43.666749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-dec739cf-bf73-4e3c-9e3d-4160fecef7f1 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Request method failure captured: Jul 01 16:41:43.666749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: DELETE /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 HTTP/1.1 Jul 01 16:41:43.666749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:41:43.666749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:41:43.666749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:41:43.666749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:41:43.666749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:41:43.666749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:41:43.666749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:41:43.666749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:41:43.666749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyOG0qgpaeh3UWlIApjA8wG4WmOBDycAmirO90h7464OCHQMOSsNI1KezqeHQjFpjtQn4Do0CRkDui_4VmjF4MtNdPeHWkHwCmr6FRjttu329l0mtebPEOMa5uQwGaWLVS0rW7Yi20_hbWIV_G8Y7pNF-xqRPiOzBogmcEdQm9GAMgE Jul 01 16:41:43.666749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:41:43.666749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:41:43.666749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:41:43.666749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:41:43.666749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:41:43.666749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:41:43.666749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: 2c49e143df7c4d059430b7dc5bffd475 Jul 01 16:41:43.666749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-DeleteServersTestJSON-1598392548 Jul 01 16:41:43.666749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:41:43.666749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:41:43.668344 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2c49e143df7c4d059430b7dc5bffd475"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2c49e143df7c4d059430b7dc5bffd475"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2c49e143df7c4d059430b7dc5bffd475"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2c49e143df7c4d059430b7dc5bffd475"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:41:43.668344 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-DeleteServersTestJSON-1598392548 Jul 01 16:41:43.668344 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 2c49e143df7c4d059430b7dc5bffd475 Jul 01 16:41:43.668344 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-DeleteServersTestJSON-1598392548 Jul 01 16:41:43.668344 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-DeleteServersTestJSON-1598392548-project Jul 01 16:41:43.668344 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:41:43.668344 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:41:43.668344 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: ea27a708e2c84ccc905ae783524bd12f Jul 01 16:41:43.668344 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-DeleteServersTestJSON-1598392548-project Jul 01 16:41:43.668344 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: > Jul 01 16:41:43.668344 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. Jul 01 16:41:43.668344 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'id': '5a4f1396-f645-4238-850e-358ca184ad19'} Jul 01 16:41:43.669212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:41:43.669212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:41:43.669212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:41:43.669212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:41:43.669212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:41:43.669212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:41:43.669212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:41:43.669212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:41:43.669212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:41:43.669212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:41:43.669212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. Jul 01 16:41:43.669212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:41:43.669212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:41:43.669212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:41:43.669212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:41:43.669212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:41:43.669212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:41:43.669212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:41:43.669212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:41:43.669212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:41:43.670881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:41:43.670881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 16:41:43.670881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 16:41:43.670881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 16:41:43.670881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 16:41:43.670881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:41:43.670881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:41:43.670881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:41:43.670881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:41:43.670881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. Jul 01 16:41:43.670881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:41:43.670881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:41:43.670881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:41:43.670881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:41:43.670881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:41:43.670881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:41:43.670881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:41:43.670881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:41:43.670881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. Jul 01 16:41:43.670881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:41:43.674913 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-dec739cf-bf73-4e3c-9e3d-4160fecef7f1 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Returning 404 to user: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:41:43.679153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-dec739cf-bf73-4e3c-9e3d-4160fecef7f1 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 404 len: 111 microversion: 2.1 time: 0.062625 Jul 01 16:41:43.681257 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 75/152] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:41:43 2022] DELETE /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:41:43.693653 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-81d81d62-34e1-4b2b-8c05-dddbabec87c7 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:43.694269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-81d81d62-34e1-4b2b-8c05-dddbabec87c7 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] [instance: 5a4f1396-f645-4238-850e-358ca184ad19] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:43.710189 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-81d81d62-34e1-4b2b-8c05-dddbabec87c7 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:43.712350 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-81d81d62-34e1-4b2b-8c05-dddbabec87c7 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:43.713142 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-81d81d62-34e1-4b2b-8c05-dddbabec87c7 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:43.715937 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-81d81d62-34e1-4b2b-8c05-dddbabec87c7 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:43.745463 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-81d81d62-34e1-4b2b-8c05-dddbabec87c7 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] HTTP exception thrown: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. Jul 01 16:41:43.747035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-81d81d62-34e1-4b2b-8c05-dddbabec87c7 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Request method failure captured: Jul 01 16:41:43.747035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 HTTP/1.1 Jul 01 16:41:43.747035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:41:43.747035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:41:43.747035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:41:43.747035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:41:43.747035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:41:43.747035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:41:43.747035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:41:43.747035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:41:43.747035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyOG0qgpaeh3UWlIApjA8wG4WmOBDycAmirO90h7464OCHQMOSsNI1KezqeHQjFpjtQn4Do0CRkDui_4VmjF4MtNdPeHWkHwCmr6FRjttu329l0mtebPEOMa5uQwGaWLVS0rW7Yi20_hbWIV_G8Y7pNF-xqRPiOzBogmcEdQm9GAMgE Jul 01 16:41:43.747035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:41:43.747035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:41:43.747035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:41:43.747035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:41:43.747035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:41:43.747035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:41:43.747035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: 2c49e143df7c4d059430b7dc5bffd475 Jul 01 16:41:43.747035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-DeleteServersTestJSON-1598392548 Jul 01 16:41:43.747035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:41:43.747035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:41:43.748416 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2c49e143df7c4d059430b7dc5bffd475"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2c49e143df7c4d059430b7dc5bffd475"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2c49e143df7c4d059430b7dc5bffd475"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2c49e143df7c4d059430b7dc5bffd475"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:41:43.748416 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-DeleteServersTestJSON-1598392548 Jul 01 16:41:43.748416 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 2c49e143df7c4d059430b7dc5bffd475 Jul 01 16:41:43.748416 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-DeleteServersTestJSON-1598392548 Jul 01 16:41:43.748416 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-DeleteServersTestJSON-1598392548-project Jul 01 16:41:43.748416 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:41:43.748416 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:41:43.748416 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: ea27a708e2c84ccc905ae783524bd12f Jul 01 16:41:43.748416 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-DeleteServersTestJSON-1598392548-project Jul 01 16:41:43.748416 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:41:43.748416 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. Jul 01 16:41:43.748416 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': '5a4f1396-f645-4238-850e-358ca184ad19'} Jul 01 16:41:43.749126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:41:43.749126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:41:43.749126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:41:43.749126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:41:43.749126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:41:43.749126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:41:43.749126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:41:43.749126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:41:43.749126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:41:43.749126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:41:43.749126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. Jul 01 16:41:43.749126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:41:43.749126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:41:43.749126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:41:43.749126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:41:43.749126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:41:43.749126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:41:43.749126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:41:43.749126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:41:43.749126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:41:43.750337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:41:43.750337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:41:43.750337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:41:43.750337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:41:43.750337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:41:43.750337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:41:43.750337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:41:43.750337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. Jul 01 16:41:43.750337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:41:43.750337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:41:43.750337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:41:43.750337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:41:43.750337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:41:43.750337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:41:43.750337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:41:43.750337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:41:43.750337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. Jul 01 16:41:43.750337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:41:43.752000 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-81d81d62-34e1-4b2b-8c05-dddbabec87c7 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] Returning 404 to user: Instance 5a4f1396-f645-4238-850e-358ca184ad19 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:41:43.752000 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-81d81d62-34e1-4b2b-8c05-dddbabec87c7 tempest-DeleteServersTestJSON-1598392548 tempest-DeleteServersTestJSON-1598392548-project] 10.222.0.57 "GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19" status: 404 len: 111 microversion: 2.1 time: 0.062802 Jul 01 16:41:43.752000 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 78/153] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:43 2022] GET /compute/v2.1/servers/5a4f1396-f645-4238-850e-358ca184ad19 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:41:44.433068 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ba88e899-dd19-4be9-a3c4-11ffdc82a1d8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:44.433677 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ba88e899-dd19-4be9-a3c4-11ffdc82a1d8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:44.440653 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ba88e899-dd19-4be9-a3c4-11ffdc82a1d8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:44.441094 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ba88e899-dd19-4be9-a3c4-11ffdc82a1d8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:44.442617 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ba88e899-dd19-4be9-a3c4-11ffdc82a1d8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:44.447705 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ba88e899-dd19-4be9-a3c4-11ffdc82a1d8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:44.730186 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ba88e899-dd19-4be9-a3c4-11ffdc82a1d8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:44.738666 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ba88e899-dd19-4be9-a3c4-11ffdc82a1d8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.309268 Jul 01 16:41:44.740782 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 76/154] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:44 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:45.760964 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ce78e133-1e54-4583-8ab5-b87e2e37cdc5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:45.761554 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ce78e133-1e54-4583-8ab5-b87e2e37cdc5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:45.771057 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ce78e133-1e54-4583-8ab5-b87e2e37cdc5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:45.771512 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ce78e133-1e54-4583-8ab5-b87e2e37cdc5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:45.772271 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ce78e133-1e54-4583-8ab5-b87e2e37cdc5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:45.781217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ce78e133-1e54-4583-8ab5-b87e2e37cdc5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:46.215138 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ce78e133-1e54-4583-8ab5-b87e2e37cdc5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:46.226069 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ce78e133-1e54-4583-8ab5-b87e2e37cdc5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.469465 Jul 01 16:41:46.226971 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 79/155] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:45 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:47.244931 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b6455c3f-dfcb-4fad-b2b2-9f4ea2917fb6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:47.246295 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b6455c3f-dfcb-4fad-b2b2-9f4ea2917fb6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:47.261870 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b6455c3f-dfcb-4fad-b2b2-9f4ea2917fb6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:47.263843 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b6455c3f-dfcb-4fad-b2b2-9f4ea2917fb6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:47.266042 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b6455c3f-dfcb-4fad-b2b2-9f4ea2917fb6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:47.268321 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b6455c3f-dfcb-4fad-b2b2-9f4ea2917fb6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:47.569617 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b6455c3f-dfcb-4fad-b2b2-9f4ea2917fb6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:47.583769 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b6455c3f-dfcb-4fad-b2b2-9f4ea2917fb6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.343350 Jul 01 16:41:47.597237 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 77/156] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:47 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:48.603222 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9a60926a-300b-4a9c-9fcc-f6437111efcb tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:48.604246 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-9a60926a-300b-4a9c-9fcc-f6437111efcb tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:48.622977 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9a60926a-300b-4a9c-9fcc-f6437111efcb tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:48.623412 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9a60926a-300b-4a9c-9fcc-f6437111efcb tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:48.624181 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9a60926a-300b-4a9c-9fcc-f6437111efcb tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:48.624612 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9a60926a-300b-4a9c-9fcc-f6437111efcb tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:48.970851 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9a60926a-300b-4a9c-9fcc-f6437111efcb tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:48.981075 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9a60926a-300b-4a9c-9fcc-f6437111efcb tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.382893 Jul 01 16:41:48.982312 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 80/157] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:48 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:50.022742 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-df1d3a8e-e28c-4d94-9e52-9cbb069d608c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:50.023977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-df1d3a8e-e28c-4d94-9e52-9cbb069d608c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:50.034696 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-df1d3a8e-e28c-4d94-9e52-9cbb069d608c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:50.035464 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-df1d3a8e-e28c-4d94-9e52-9cbb069d608c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:50.037369 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-df1d3a8e-e28c-4d94-9e52-9cbb069d608c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:50.038186 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-df1d3a8e-e28c-4d94-9e52-9cbb069d608c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:50.257278 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-df1d3a8e-e28c-4d94-9e52-9cbb069d608c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:50.265386 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-df1d3a8e-e28c-4d94-9e52-9cbb069d608c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.247482 Jul 01 16:41:50.272550 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 78/158] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:50 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:51.294716 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-aca86b6e-76cd-43b1-b99b-6d9551e45630 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:51.296119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-aca86b6e-76cd-43b1-b99b-6d9551e45630 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:51.308189 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aca86b6e-76cd-43b1-b99b-6d9551e45630 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:51.309732 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aca86b6e-76cd-43b1-b99b-6d9551e45630 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:51.310580 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aca86b6e-76cd-43b1-b99b-6d9551e45630 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:51.311669 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aca86b6e-76cd-43b1-b99b-6d9551e45630 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:51.512618 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-aca86b6e-76cd-43b1-b99b-6d9551e45630 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:51.523515 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-aca86b6e-76cd-43b1-b99b-6d9551e45630 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.241726 Jul 01 16:41:51.536331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 81/159] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:51 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:52.245147 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6f858d36-ac86-4f01-8f1f-ea4d30537310 tempest-VolumesGetTestJSON-1614745509 tempest-VolumesGetTestJSON-1614745509-project] Action: 'create', calling method: .version_select at 0x7fa85f5a1e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1383631893", "metadata": {"Type": "work"}}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:41:52.543368 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-fc29b83b-c68e-46e2-9da7-a33a6b3430e6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:52.543989 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-fc29b83b-c68e-46e2-9da7-a33a6b3430e6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:52.560303 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fc29b83b-c68e-46e2-9da7-a33a6b3430e6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:52.570887 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fc29b83b-c68e-46e2-9da7-a33a6b3430e6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:52.572552 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fc29b83b-c68e-46e2-9da7-a33a6b3430e6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:52.573023 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fc29b83b-c68e-46e2-9da7-a33a6b3430e6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:52.942373 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6f858d36-ac86-4f01-8f1f-ea4d30537310 tempest-VolumesGetTestJSON-1614745509 tempest-VolumesGetTestJSON-1614745509-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.918945 Jul 01 16:41:52.949143 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 79/160] 10.222.0.57 () {60 vars in 1155 bytes} [Fri Jul 1 16:41:52 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 920 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 01 16:41:52.958154 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-15e2b686-bd38-4870-85a7-3b19a4a1b7d9 tempest-VolumesGetTestJSON-1614745509 tempest-VolumesGetTestJSON-1614745509-project] Calling method '.version_select at 0x7fa85f5e6310>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:53.058568 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-fc29b83b-c68e-46e2-9da7-a33a6b3430e6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:53.065623 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-fc29b83b-c68e-46e2-9da7-a33a6b3430e6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.526495 Jul 01 16:41:53.080071 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-15e2b686-bd38-4870-85a7-3b19a4a1b7d9 tempest-VolumesGetTestJSON-1614745509 tempest-VolumesGetTestJSON-1614745509-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/00ada911-3711-4cbb-be20-b919ddbb553e" status: 200 len: 353 microversion: 2.1 time: 0.126520 Jul 01 16:41:53.080611 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 82/161] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:52 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:53.081167 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 80/162] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 1 16:41:52 2022] GET /compute/v2.1/os-volumes/00ada911-3711-4cbb-be20-b919ddbb553e => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:41:54.095183 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-73ce802b-33a0-45c8-8756-26a8eb408197 tempest-VolumesGetTestJSON-1614745509 tempest-VolumesGetTestJSON-1614745509-project] Calling method '.version_select at 0x7fa86c60dee0>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:54.101193 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f8d504de-1ad7-426b-90d6-b50599dc5102 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:54.103033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f8d504de-1ad7-426b-90d6-b50599dc5102 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:54.115307 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f8d504de-1ad7-426b-90d6-b50599dc5102 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:54.115757 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f8d504de-1ad7-426b-90d6-b50599dc5102 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:54.116515 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f8d504de-1ad7-426b-90d6-b50599dc5102 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:54.118470 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f8d504de-1ad7-426b-90d6-b50599dc5102 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:54.196167 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-73ce802b-33a0-45c8-8756-26a8eb408197 tempest-VolumesGetTestJSON-1614745509 tempest-VolumesGetTestJSON-1614745509-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/00ada911-3711-4cbb-be20-b919ddbb553e" status: 200 len: 354 microversion: 2.1 time: 0.105516 Jul 01 16:41:54.203907 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 83/163] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 1 16:41:54 2022] GET /compute/v2.1/os-volumes/00ada911-3711-4cbb-be20-b919ddbb553e => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:41:54.209100 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c6cb4c74-ccc7-44e9-9392-d1dfdf42428e tempest-VolumesGetTestJSON-1614745509 tempest-VolumesGetTestJSON-1614745509-project] Calling method '.version_select at 0x7fa86c85bee0>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:54.269407 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c6cb4c74-ccc7-44e9-9392-d1dfdf42428e tempest-VolumesGetTestJSON-1614745509 tempest-VolumesGetTestJSON-1614745509-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/00ada911-3711-4cbb-be20-b919ddbb553e" status: 200 len: 354 microversion: 2.1 time: 0.064165 Jul 01 16:41:54.269983 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 84/164] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 1 16:41:54 2022] GET /compute/v2.1/os-volumes/00ada911-3711-4cbb-be20-b919ddbb553e => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:41:54.278712 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f8d504de-1ad7-426b-90d6-b50599dc5102 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:54.288579 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-26b661e9-d3e1-4ceb-aa91-ff2e61189d96 tempest-VolumesGetTestJSON-1614745509 tempest-VolumesGetTestJSON-1614745509-project] Calling method '.version_select at 0x7fa86c6149d0>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:54.288761 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f8d504de-1ad7-426b-90d6-b50599dc5102 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.191582 Jul 01 16:41:54.289223 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 81/165] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:54 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:54.361207 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-26b661e9-d3e1-4ceb-aa91-ff2e61189d96 tempest-VolumesGetTestJSON-1614745509 tempest-VolumesGetTestJSON-1614745509-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/00ada911-3711-4cbb-be20-b919ddbb553e" status: 202 len: 0 microversion: 2.1 time: 0.078336 Jul 01 16:41:54.361783 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 85/166] 10.222.0.57 () {58 vars in 1247 bytes} [Fri Jul 1 16:41:54 2022] DELETE /compute/v2.1/os-volumes/00ada911-3711-4cbb-be20-b919ddbb553e => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 16:41:54.370569 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4f55189e-f918-497c-b0d5-a75162865c6a tempest-VolumesGetTestJSON-1614745509 tempest-VolumesGetTestJSON-1614745509-project] Calling method '.version_select at 0x7fa85f5df8b0>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:54.425385 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4f55189e-f918-497c-b0d5-a75162865c6a tempest-VolumesGetTestJSON-1614745509 tempest-VolumesGetTestJSON-1614745509-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/00ada911-3711-4cbb-be20-b919ddbb553e" status: 200 len: 353 microversion: 2.1 time: 0.059244 Jul 01 16:41:54.426063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 82/167] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 1 16:41:54 2022] GET /compute/v2.1/os-volumes/00ada911-3711-4cbb-be20-b919ddbb553e => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:41:54.435528 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9dbe9d2f-4213-4ef5-a5c5-0948cc82a394 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Action: 'create', calling method: .version_select at 0x7fa86c85b8b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1408550488", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVT6/hgloYlHrChIyx59OSM69SiLQ9GAW+Xjz/URlXvdRNZ4WwEg05JilG4yJ8kc23HfRY6JPWuBEgo7sTDlC/omo/lNFDaoMAKER4H6xHOF52nbcnp/AHeejPlRdtoFQ=="}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:41:54.454429 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-9dbe9d2f-4213-4ef5-a5c5-0948cc82a394 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Getting quotas for project ef0cc672766c47759a088a398d95147f. Resources: {'key_pairs'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:41:54.459469 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-9dbe9d2f-4213-4ef5-a5c5-0948cc82a394 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Getting quotas for user c1ab0b52325c4ab387db034eb7dfcadb and project ef0cc672766c47759a088a398d95147f. Resources: {'key_pairs'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:41:54.496949 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9dbe9d2f-4213-4ef5-a5c5-0948cc82a394 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.065213 Jul 01 16:41:54.497541 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 86/168] 10.222.0.57 () {60 vars in 1158 bytes} [Fri Jul 1 16:41:54 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:41:54.596817 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0de87e40-d0e3-4fa0-8e2b-930d4fb8e925 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-818071732", "imageRef": "6b5ac1b4-5aec-4864-8e7e-498c8627b5d5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1408550488", "networks": [{"uuid": "2ae80d44-e5eb-422c-be0c-2606e5c357a3"}]}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:41:54.649533 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-0de87e40-d0e3-4fa0-8e2b-930d4fb8e925 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] validate_networks() for [('2ae80d44-e5eb-422c-be0c-2606e5c357a3', None, None, None, None, None)] {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 16:41:54.876980 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-07c94334-f8dc-4096-9164-9a5f12b428d6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1888131314", "imageRef": "42a4b1a9-dea6-4c87-a2c1-328b9c0c8558", "flavorRef": "452", "networks": [{"uuid": "75014e88-f269-4136-926c-e34ab9a26542"}]}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:41:54.928810 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.network.neutron [None req-07c94334-f8dc-4096-9164-9a5f12b428d6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] validate_networks() for [('75014e88-f269-4136-926c-e34ab9a26542', None, None, None, None, None)] {{(pid=124317) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 16:41:55.128815 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-0de87e40-d0e3-4fa0-8e2b-930d4fb8e925 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 16:41:55.130025 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-0de87e40-d0e3-4fa0-8e2b-930d4fb8e925 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 16:41:55.130894 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-0de87e40-d0e3-4fa0-8e2b-930d4fb8e925 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 16:41:55.131476 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-0de87e40-d0e3-4fa0-8e2b-930d4fb8e925 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 16:41:55.132077 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-0de87e40-d0e3-4fa0-8e2b-930d4fb8e925 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 16:41:55.144387 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0de87e40-d0e3-4fa0-8e2b-930d4fb8e925 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:55.144838 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0de87e40-d0e3-4fa0-8e2b-930d4fb8e925 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:55.145640 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0de87e40-d0e3-4fa0-8e2b-930d4fb8e925 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:55.146365 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0de87e40-d0e3-4fa0-8e2b-930d4fb8e925 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:55.164950 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-0de87e40-d0e3-4fa0-8e2b-930d4fb8e925 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Getting quotas for project ef0cc672766c47759a088a398d95147f. Resources: {'ram', 'cores', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:41:55.169348 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-0de87e40-d0e3-4fa0-8e2b-930d4fb8e925 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Getting quotas for user c1ab0b52325c4ab387db034eb7dfcadb and project ef0cc672766c47759a088a398d95147f. Resources: {'ram', 'cores', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:41:55.181908 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0de87e40-d0e3-4fa0-8e2b-930d4fb8e925 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 16:41:55.184140 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0de87e40-d0e3-4fa0-8e2b-930d4fb8e925 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b5ac1b4-5aec-4864-8e7e-498c8627b5d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 16:41:55.234124 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0de87e40-d0e3-4fa0-8e2b-930d4fb8e925 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641246 Jul 01 16:41:55.238748 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 83/169] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 1 16:41:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 16:41:55.246696 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-7841e008-d439-4571-8a54-ae8d85eea588 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:55.247598 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-7841e008-d439-4571-8a54-ae8d85eea588 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:55.340054 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7841e008-d439-4571-8a54-ae8d85eea588 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:55.349742 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-7841e008-d439-4571-8a54-ae8d85eea588 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1258 microversion: 2.1 time: 0.107915 Jul 01 16:41:55.359190 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 84/170] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:55 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1258 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:41:55.364667 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ca89c37d-359e-48d2-af15-55d3611be3d7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:55.365594 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ca89c37d-359e-48d2-af15-55d3611be3d7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:55.373374 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ca89c37d-359e-48d2-af15-55d3611be3d7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:55.374269 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ca89c37d-359e-48d2-af15-55d3611be3d7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:55.375484 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ca89c37d-359e-48d2-af15-55d3611be3d7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:55.376211 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ca89c37d-359e-48d2-af15-55d3611be3d7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:55.544569 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-07c94334-f8dc-4096-9164-9a5f12b428d6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Flavor limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 16:41:55.545026 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-07c94334-f8dc-4096-9164-9a5f12b428d6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Image limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 16:41:55.545487 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-07c94334-f8dc-4096-9164-9a5f12b428d6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Flavor pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 16:41:55.545896 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-07c94334-f8dc-4096-9164-9a5f12b428d6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Image pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 16:41:55.546305 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-07c94334-f8dc-4096-9164-9a5f12b428d6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 16:41:55.567811 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-07c94334-f8dc-4096-9164-9a5f12b428d6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:55.568382 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-07c94334-f8dc-4096-9164-9a5f12b428d6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:55.569293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-07c94334-f8dc-4096-9164-9a5f12b428d6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:55.569830 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-07c94334-f8dc-4096-9164-9a5f12b428d6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:55.590154 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-07c94334-f8dc-4096-9164-9a5f12b428d6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Getting quotas for project b6598cf49d3a4426be411fa45be0c7c8. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:41:55.594719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-07c94334-f8dc-4096-9164-9a5f12b428d6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Getting quotas for user 1f2a1540974a444f8341d395d6a2b070 and project b6598cf49d3a4426be411fa45be0c7c8. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:41:55.611456 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-07c94334-f8dc-4096-9164-9a5f12b428d6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Going to run 1 instances... {{(pid=124317) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 16:41:55.614633 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-07c94334-f8dc-4096-9164-9a5f12b428d6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42a4b1a9-dea6-4c87-a2c1-328b9c0c8558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124317) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 16:41:55.676914 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-07c94334-f8dc-4096-9164-9a5f12b428d6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.804595 Jul 01 16:41:55.678073 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 87/171] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 1 16:41:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 16:41:55.683900 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1d200963-6a6c-44a3-8de3-20d9e4c524cb tempest-VolumesGetTestJSON-1614745509 tempest-VolumesGetTestJSON-1614745509-project] Calling method '.version_select at 0x7fa86c614a60>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:55.729112 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-1d200963-6a6c-44a3-8de3-20d9e4c524cb tempest-VolumesGetTestJSON-1614745509 tempest-VolumesGetTestJSON-1614745509-project] HTTP exception thrown: Volume 00ada911-3711-4cbb-be20-b919ddbb553e could not be found. Jul 01 16:41:55.731365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1d200963-6a6c-44a3-8de3-20d9e4c524cb tempest-VolumesGetTestJSON-1614745509 tempest-VolumesGetTestJSON-1614745509-project] Request method failure captured: Jul 01 16:41:55.731365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/os-volumes/00ada911-3711-4cbb-be20-b919ddbb553e HTTP/1.1 Jul 01 16:41:55.731365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:41:55.731365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:41:55.731365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:41:55.731365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:41:55.731365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:41:55.731365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:41:55.731365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:41:55.731365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:41:55.731365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyPPhreV3dZXDw3PNLIiCPhKeFD_xmCTzPKmYON4d23C2peuL64Jqryv8vbC_3oZWvWaAdVDZnPn_oCNT9Ncx1E6VykD-XflG6E0eyJhoopCp8KdpQDcESZgFBRquGZyWIzcm_LgVBWdXf7GhZvkVOIEc_41TQMI0F467h0rk10WBKM Jul 01 16:41:55.731365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:41:55.731365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:41:55.731365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:41:55.731365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:41:55.731365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:41:55.731365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:41:55.731365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: 409e26052ea7472fb3448a97267cee95 Jul 01 16:41:55.731365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-VolumesGetTestJSON-1614745509 Jul 01 16:41:55.731365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:41:55.731365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:41:55.732874 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/409e26052ea7472fb3448a97267cee95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/409e26052ea7472fb3448a97267cee95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_409e26052ea7472fb3448a97267cee95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/409e26052ea7472fb3448a97267cee95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:41:55.732874 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-VolumesGetTestJSON-1614745509 Jul 01 16:41:55.732874 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 409e26052ea7472fb3448a97267cee95 Jul 01 16:41:55.732874 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-VolumesGetTestJSON-1614745509 Jul 01 16:41:55.732874 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-VolumesGetTestJSON-1614745509-project Jul 01 16:41:55.732874 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:41:55.732874 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:41:55.732874 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: ee49f8d0c0444d4fa4a6cb69f08f77a9 Jul 01 16:41:55.732874 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-VolumesGetTestJSON-1614745509-project Jul 01 16:41:55.732874 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: Jul 01 16:41:55.732874 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Volume 00ada911-3711-4cbb-be20-b919ddbb553e could not be found. Jul 01 16:41:55.732874 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': '00ada911-3711-4cbb-be20-b919ddbb553e'} Jul 01 16:41:55.732874 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:41:55.733707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:41:55.733707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 16:41:55.733707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 16:41:55.733707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 16:41:55.733707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 16:41:55.733707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 16:41:55.733707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 16:41:55.733707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 16:41:55.733707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 16:41:55.733707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 16:41:55.733707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 16:41:55.733707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 16:41:55.733707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 16:41:55.733707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 16:41:55.733707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 16:41:55.733707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 00ada911-3711-4cbb-be20-b919ddbb553e could not be found. (HTTP 404) (Request-ID: req-0a28c58b-8247-4159-b039-d85eeffb44c6) Jul 01 16:41:55.733707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:41:55.733707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:41:55.733707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:41:55.735843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:41:55.735843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 16:41:55.735843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 16:41:55.735843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 16:41:55.735843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 16:41:55.735843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 16:41:55.735843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 16:41:55.735843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 16:41:55.735843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 16:41:55.735843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 16:41:55.735843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 16:41:55.735843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 16:41:55.735843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 16:41:55.735843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 16:41:55.735843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 16:41:55.735843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 16:41:55.735843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 16:41:55.735843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 16:41:55.735843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 16:41:55.737119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 16:41:55.737119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 16:41:55.737119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 16:41:55.737119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 16:41:55.737119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 00ada911-3711-4cbb-be20-b919ddbb553e could not be found. Jul 01 16:41:55.737119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:41:55.737119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:41:55.737119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:41:55.737119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:41:55.737119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:41:55.737119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:41:55.737119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:41:55.737119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:41:55.737119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 16:41:55.737119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 16:41:55.737119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:41:55.737119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:41:55.737119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 16:41:55.737119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:41:55.738482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 00ada911-3711-4cbb-be20-b919ddbb553e could not be found. Jul 01 16:41:55.738482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:41:55.738482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:41:55.738482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:41:55.738482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:41:55.738482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:41:55.738482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:41:55.738482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:41:55.738482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:41:55.738482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 00ada911-3711-4cbb-be20-b919ddbb553e could not be found. Jul 01 16:41:55.738482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:41:55.740611 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1d200963-6a6c-44a3-8de3-20d9e4c524cb tempest-VolumesGetTestJSON-1614745509 tempest-VolumesGetTestJSON-1614745509-project] Returning 404 to user: Volume 00ada911-3711-4cbb-be20-b919ddbb553e could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:41:55.741745 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1d200963-6a6c-44a3-8de3-20d9e4c524cb tempest-VolumesGetTestJSON-1614745509 tempest-VolumesGetTestJSON-1614745509-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/00ada911-3711-4cbb-be20-b919ddbb553e" status: 404 len: 109 microversion: 2.1 time: 0.062250 Jul 01 16:41:55.742687 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 88/172] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 1 16:41:55 2022] GET /compute/v2.1/os-volumes/00ada911-3711-4cbb-be20-b919ddbb553e => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:41:55.749745 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d5c36eee-ccc4-4a77-8a53-36903912d1e1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:55.750945 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d5c36eee-ccc4-4a77-8a53-36903912d1e1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:55.868059 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ca89c37d-359e-48d2-af15-55d3611be3d7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:55.878824 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ca89c37d-359e-48d2-af15-55d3611be3d7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.526900 Jul 01 16:41:55.879448 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 85/173] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:55 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:55.899846 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d5c36eee-ccc4-4a77-8a53-36903912d1e1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:55.908872 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d5c36eee-ccc4-4a77-8a53-36903912d1e1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1214 microversion: 2.1 time: 0.164848 Jul 01 16:41:55.909447 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 89/174] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:55 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:56.367525 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6b1d857d-d964-4cf9-be44-49dc42015403 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:56.368592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6b1d857d-d964-4cf9-be44-49dc42015403 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:56.375821 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6b1d857d-d964-4cf9-be44-49dc42015403 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:56.376340 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6b1d857d-d964-4cf9-be44-49dc42015403 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:56.377345 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6b1d857d-d964-4cf9-be44-49dc42015403 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:56.377773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6b1d857d-d964-4cf9-be44-49dc42015403 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:56.447729 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6b1d857d-d964-4cf9-be44-49dc42015403 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:56.455484 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6b1d857d-d964-4cf9-be44-49dc42015403 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1310 microversion: 2.1 time: 0.092372 Jul 01 16:41:56.456047 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 86/175] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:56 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:56.897384 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d2c75be2-0ebf-412d-b142-5311b5a52ea0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:56.898721 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d2c75be2-0ebf-412d-b142-5311b5a52ea0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:56.904998 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d2c75be2-0ebf-412d-b142-5311b5a52ea0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:56.905546 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d2c75be2-0ebf-412d-b142-5311b5a52ea0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:56.906986 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d2c75be2-0ebf-412d-b142-5311b5a52ea0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:56.907656 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d2c75be2-0ebf-412d-b142-5311b5a52ea0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:56.912282 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=93,nova_cell1:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:56.931170 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-07a1262b-965f-4476-93b5-d5944d5df5d8 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:56.932241 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-07a1262b-965f-4476-93b5-d5944d5df5d8 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:56.943670 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-07a1262b-965f-4476-93b5-d5944d5df5d8 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:56.944899 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-07a1262b-965f-4476-93b5-d5944d5df5d8 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:56.946816 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-07a1262b-965f-4476-93b5-d5944d5df5d8 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:56.947422 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-07a1262b-965f-4476-93b5-d5944d5df5d8 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:56.971314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:57.026048 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-07a1262b-965f-4476-93b5-d5944d5df5d8 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:57.037145 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-07a1262b-965f-4476-93b5-d5944d5df5d8 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1210 microversion: 2.1 time: 0.113520 Jul 01 16:41:57.037725 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 87/176] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:56 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1210 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:57.086992 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d2c75be2-0ebf-412d-b142-5311b5a52ea0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:57.096166 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d2c75be2-0ebf-412d-b142-5311b5a52ea0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1521 microversion: 2.1 time: 0.202901 Jul 01 16:41:57.096746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 90/177] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:56 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:57.475388 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-76e6b706-dbfa-4da7-bd81-dfe8126baade tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:57.477286 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-76e6b706-dbfa-4da7-bd81-dfe8126baade tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:57.487977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-76e6b706-dbfa-4da7-bd81-dfe8126baade tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:57.488850 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-76e6b706-dbfa-4da7-bd81-dfe8126baade tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:57.490176 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-76e6b706-dbfa-4da7-bd81-dfe8126baade tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:57.491732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-76e6b706-dbfa-4da7-bd81-dfe8126baade tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:57.576473 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-76e6b706-dbfa-4da7-bd81-dfe8126baade tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:57.585407 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-76e6b706-dbfa-4da7-bd81-dfe8126baade tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1328 microversion: 2.1 time: 0.116154 Jul 01 16:41:57.586326 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 88/178] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:57 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1328 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:58.057749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3a30e18c-bdcd-4581-9ab3-3a70ffbb1423 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:58.059634 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3a30e18c-bdcd-4581-9ab3-3a70ffbb1423 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:58.073810 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3a30e18c-bdcd-4581-9ab3-3a70ffbb1423 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:58.077853 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3a30e18c-bdcd-4581-9ab3-3a70ffbb1423 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:58.080153 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3a30e18c-bdcd-4581-9ab3-3a70ffbb1423 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:58.080839 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3a30e18c-bdcd-4581-9ab3-3a70ffbb1423 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:58.114973 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-77957ef4-d45d-470e-979a-5b750c96cdff tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:58.116803 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-77957ef4-d45d-470e-979a-5b750c96cdff tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:58.125466 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-77957ef4-d45d-470e-979a-5b750c96cdff tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:58.129775 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-77957ef4-d45d-470e-979a-5b750c96cdff tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:58.134582 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-77957ef4-d45d-470e-979a-5b750c96cdff tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:58.135974 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-77957ef4-d45d-470e-979a-5b750c96cdff tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:58.311396 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3a30e18c-bdcd-4581-9ab3-3a70ffbb1423 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:58.320173 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3a30e18c-bdcd-4581-9ab3-3a70ffbb1423 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1274 microversion: 2.1 time: 0.268139 Jul 01 16:41:58.325791 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 91/179] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:58 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1274 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:58.603599 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9078f789-ff9a-4720-8fa1-2a3ab1056010 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:58.604554 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-9078f789-ff9a-4720-8fa1-2a3ab1056010 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:58.606948 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:58.620534 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9078f789-ff9a-4720-8fa1-2a3ab1056010 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:58.621207 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9078f789-ff9a-4720-8fa1-2a3ab1056010 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:58.622288 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9078f789-ff9a-4720-8fa1-2a3ab1056010 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:58.626873 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9078f789-ff9a-4720-8fa1-2a3ab1056010 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:59.086642 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-77957ef4-d45d-470e-979a-5b750c96cdff tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:59.100652 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-77957ef4-d45d-470e-979a-5b750c96cdff tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1501 microversion: 2.1 time: 0.991261 Jul 01 16:41:59.105886 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 89/180] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:58 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1501 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:41:59.143702 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-eefb9823-844c-4317-abf4-ea77ece3fb00 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:59.148168 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-eefb9823-844c-4317-abf4-ea77ece3fb00 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:59.176018 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eefb9823-844c-4317-abf4-ea77ece3fb00 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:59.179731 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eefb9823-844c-4317-abf4-ea77ece3fb00 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:59.181854 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eefb9823-844c-4317-abf4-ea77ece3fb00 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:59.184999 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eefb9823-844c-4317-abf4-ea77ece3fb00 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:59.494265 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9078f789-ff9a-4720-8fa1-2a3ab1056010 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:59.507191 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9078f789-ff9a-4720-8fa1-2a3ab1056010 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.907008 Jul 01 16:41:59.509316 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 92/181] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:58 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:41:59.520065 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0ba9fdee-ee1a-4a71-98c6-a5aa7c92e86d tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:41:59.520691 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0ba9fdee-ee1a-4a71-98c6-a5aa7c92e86d tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:41:59.544868 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0ba9fdee-ee1a-4a71-98c6-a5aa7c92e86d tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:59.545651 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0ba9fdee-ee1a-4a71-98c6-a5aa7c92e86d tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:59.546744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0ba9fdee-ee1a-4a71-98c6-a5aa7c92e86d tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:41:59.548103 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0ba9fdee-ee1a-4a71-98c6-a5aa7c92e86d tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:41:59.646791 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-eefb9823-844c-4317-abf4-ea77ece3fb00 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:59.658628 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-eefb9823-844c-4317-abf4-ea77ece3fb00 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1517 microversion: 2.1 time: 0.534135 Jul 01 16:41:59.671630 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 90/182] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:59 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1517 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:41:59.706988 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0ba9fdee-ee1a-4a71-98c6-a5aa7c92e86d tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:41:59.718518 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0ba9fdee-ee1a-4a71-98c6-a5aa7c92e86d tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1272 microversion: 2.1 time: 0.208075 Jul 01 16:41:59.719739 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 93/183] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:41:59 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:00.527534 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c1b03ced-ca7f-47ee-8892-31435c643fb0 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:00.528936 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c1b03ced-ca7f-47ee-8892-31435c643fb0 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:00.539845 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c1b03ced-ca7f-47ee-8892-31435c643fb0 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:00.540703 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c1b03ced-ca7f-47ee-8892-31435c643fb0 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:00.541930 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c1b03ced-ca7f-47ee-8892-31435c643fb0 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:00.542912 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c1b03ced-ca7f-47ee-8892-31435c643fb0 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:00.654479 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-d8956a6c-1713-40d9-9adb-07424b6a2859 req-0e99f7dc-2dc4-4e66-a81b-4572225d9443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74fca065-c0ba-4a16-958e-a991e16bb913", "tag": "74960809-e36c-4511-9a63-5f955f9a40f0"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:00.697148 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-d8956a6c-1713-40d9-9adb-07424b6a2859 req-0e99f7dc-2dc4-4e66-a81b-4572225d9443 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:00.697581 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-d8956a6c-1713-40d9-9adb-07424b6a2859 req-0e99f7dc-2dc4-4e66-a81b-4572225d9443 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:00.755209 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-d8956a6c-1713-40d9-9adb-07424b6a2859 req-0e99f7dc-2dc4-4e66-a81b-4572225d9443 service nova] Creating event network-changed:74960809-e36c-4511-9a63-5f955f9a40f0 for instance 74fca065-c0ba-4a16-958e-a991e16bb913 on hv-cinder-79760 Jul 01 16:42:00.771544 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-d8956a6c-1713-40d9-9adb-07424b6a2859 req-0e99f7dc-2dc4-4e66-a81b-4572225d9443 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120984 Jul 01 16:42:00.788317 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 94/184] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:42:00.804025 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a7b4d923-2954-49a4-9d7a-2b4e5b6796c6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:00.804755 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a7b4d923-2954-49a4-9d7a-2b4e5b6796c6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:00.824622 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a7b4d923-2954-49a4-9d7a-2b4e5b6796c6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:00.825078 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a7b4d923-2954-49a4-9d7a-2b4e5b6796c6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:00.831689 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a7b4d923-2954-49a4-9d7a-2b4e5b6796c6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:00.832587 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a7b4d923-2954-49a4-9d7a-2b4e5b6796c6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:00.890243 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c1b03ced-ca7f-47ee-8892-31435c643fb0 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:00.907178 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c1b03ced-ca7f-47ee-8892-31435c643fb0 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.385273 Jul 01 16:42:00.910412 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 91/185] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:00 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:01.068046 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a7b4d923-2954-49a4-9d7a-2b4e5b6796c6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:01.076016 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a7b4d923-2954-49a4-9d7a-2b4e5b6796c6 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1314 microversion: 2.1 time: 0.288151 Jul 01 16:42:01.089423 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 95/186] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:00 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:01.485909 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e2c638bd-f4ae-4922-81ad-18fbaf74bc87 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:01.486973 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e2c638bd-f4ae-4922-81ad-18fbaf74bc87 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:01.494562 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e2c638bd-f4ae-4922-81ad-18fbaf74bc87 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:01.495017 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e2c638bd-f4ae-4922-81ad-18fbaf74bc87 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:01.495805 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e2c638bd-f4ae-4922-81ad-18fbaf74bc87 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:01.496243 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e2c638bd-f4ae-4922-81ad-18fbaf74bc87 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:01.523589 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-e2c638bd-f4ae-4922-81ad-18fbaf74bc87 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lazy-loading 'flavor' on Instance uuid ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:42:01.650828 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e2c638bd-f4ae-4922-81ad-18fbaf74bc87 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "POST /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956/action" status: 200 len: 32 microversion: 2.1 time: 0.168744 Jul 01 16:42:01.656045 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 92/187] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 1 16:42:01 2022] POST /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 16:42:01.662476 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5efd3966-c371-432e-83f5-543efd04afc1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:01.664096 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5efd3966-c371-432e-83f5-543efd04afc1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:01.670468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5efd3966-c371-432e-83f5-543efd04afc1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:01.670912 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5efd3966-c371-432e-83f5-543efd04afc1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:01.671718 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5efd3966-c371-432e-83f5-543efd04afc1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:01.672249 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5efd3966-c371-432e-83f5-543efd04afc1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:01.825975 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5efd3966-c371-432e-83f5-543efd04afc1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:01.841123 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5efd3966-c371-432e-83f5-543efd04afc1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.183210 Jul 01 16:42:01.842070 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 96/188] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:01 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:01.927194 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-855b94f7-f4d7-4e74-a701-207369b1a1cb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:01.928187 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-855b94f7-f4d7-4e74-a701-207369b1a1cb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:01.934648 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-855b94f7-f4d7-4e74-a701-207369b1a1cb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:01.935327 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-855b94f7-f4d7-4e74-a701-207369b1a1cb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:01.936318 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-855b94f7-f4d7-4e74-a701-207369b1a1cb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:01.936939 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-855b94f7-f4d7-4e74-a701-207369b1a1cb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:02.094191 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-269d8a01-f99f-4e07-b5cf-1feec2840363 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:02.094994 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-269d8a01-f99f-4e07-b5cf-1feec2840363 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:02.101474 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-269d8a01-f99f-4e07-b5cf-1feec2840363 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:02.102318 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-269d8a01-f99f-4e07-b5cf-1feec2840363 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:02.103370 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-269d8a01-f99f-4e07-b5cf-1feec2840363 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:02.103998 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-269d8a01-f99f-4e07-b5cf-1feec2840363 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:02.113225 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-855b94f7-f4d7-4e74-a701-207369b1a1cb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:02.125132 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-855b94f7-f4d7-4e74-a701-207369b1a1cb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.203119 Jul 01 16:42:02.136365 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 93/189] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:01 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:02.312250 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-269d8a01-f99f-4e07-b5cf-1feec2840363 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:02.325715 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-269d8a01-f99f-4e07-b5cf-1feec2840363 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1314 microversion: 2.1 time: 0.235109 Jul 01 16:42:02.326927 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 97/190] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:02 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:02.862324 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-54729192-4bbb-46e7-97dd-74af480b5cf5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:02.863222 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-54729192-4bbb-46e7-97dd-74af480b5cf5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:02.876342 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-54729192-4bbb-46e7-97dd-74af480b5cf5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:02.877055 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-54729192-4bbb-46e7-97dd-74af480b5cf5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:02.879380 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-54729192-4bbb-46e7-97dd-74af480b5cf5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:02.880739 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-54729192-4bbb-46e7-97dd-74af480b5cf5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:03.085364 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-54729192-4bbb-46e7-97dd-74af480b5cf5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:03.095055 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-54729192-4bbb-46e7-97dd-74af480b5cf5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.237858 Jul 01 16:42:03.098400 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 94/191] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:02 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:03.150481 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ff1c12b4-4081-41fe-8073-7e002091e7ff tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:03.151081 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ff1c12b4-4081-41fe-8073-7e002091e7ff tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:03.158661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ff1c12b4-4081-41fe-8073-7e002091e7ff tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:03.159144 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ff1c12b4-4081-41fe-8073-7e002091e7ff tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:03.160059 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ff1c12b4-4081-41fe-8073-7e002091e7ff tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:03.160558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ff1c12b4-4081-41fe-8073-7e002091e7ff tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:03.306856 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ff1c12b4-4081-41fe-8073-7e002091e7ff tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:03.315690 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ff1c12b4-4081-41fe-8073-7e002091e7ff tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.169193 Jul 01 16:42:03.316957 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 98/192] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:03 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:03.345406 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fb65bad0-4149-4b19-b1a2-222aea96d034 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:03.346114 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-fb65bad0-4149-4b19-b1a2-222aea96d034 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:03.356748 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fb65bad0-4149-4b19-b1a2-222aea96d034 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:03.357889 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fb65bad0-4149-4b19-b1a2-222aea96d034 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:03.361378 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fb65bad0-4149-4b19-b1a2-222aea96d034 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:03.361854 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fb65bad0-4149-4b19-b1a2-222aea96d034 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:03.557574 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fb65bad0-4149-4b19-b1a2-222aea96d034 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:03.566652 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fb65bad0-4149-4b19-b1a2-222aea96d034 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1314 microversion: 2.1 time: 0.226467 Jul 01 16:42:03.567799 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 95/193] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:03 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:03.657712 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-efa5a339-879f-4c79-b6c9-9de7dd87d3fb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:03.658543 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-efa5a339-879f-4c79-b6c9-9de7dd87d3fb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:03.672722 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-efa5a339-879f-4c79-b6c9-9de7dd87d3fb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:03.676556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-efa5a339-879f-4c79-b6c9-9de7dd87d3fb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:03.677953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-efa5a339-879f-4c79-b6c9-9de7dd87d3fb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:03.678434 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-efa5a339-879f-4c79-b6c9-9de7dd87d3fb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:03.705180 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-efa5a339-879f-4c79-b6c9-9de7dd87d3fb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e/ips" status: 200 len: 151 microversion: 2.1 time: 0.052486 Jul 01 16:42:03.705946 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 99/194] 10.222.0.57 () {58 vars in 1247 bytes} [Fri Jul 1 16:42:03 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e/ips => generated 151 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:42:04.116328 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-90847267-a3ff-4872-be69-d1d5ffe997a5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:04.116957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-90847267-a3ff-4872-be69-d1d5ffe997a5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:04.134510 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-90847267-a3ff-4872-be69-d1d5ffe997a5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:04.134816 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-90847267-a3ff-4872-be69-d1d5ffe997a5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:04.135602 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-90847267-a3ff-4872-be69-d1d5ffe997a5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:04.136045 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-90847267-a3ff-4872-be69-d1d5ffe997a5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:04.342938 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-fdb8c84e-8ea4-4dc6-a94d-5e21a15dc398 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:04.345377 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-fdb8c84e-8ea4-4dc6-a94d-5e21a15dc398 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:04.353540 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fdb8c84e-8ea4-4dc6-a94d-5e21a15dc398 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:04.354277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fdb8c84e-8ea4-4dc6-a94d-5e21a15dc398 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:04.355461 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fdb8c84e-8ea4-4dc6-a94d-5e21a15dc398 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:04.356852 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fdb8c84e-8ea4-4dc6-a94d-5e21a15dc398 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:04.463508 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-90847267-a3ff-4872-be69-d1d5ffe997a5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:04.476120 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-90847267-a3ff-4872-be69-d1d5ffe997a5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.364748 Jul 01 16:42:04.492749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 96/195] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:04 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:04.584245 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-fdb8c84e-8ea4-4dc6-a94d-5e21a15dc398 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:04.584822 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cd8ce2ac-6fc4-474e-999e-56327bcaccfd tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:04.585547 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-cd8ce2ac-6fc4-474e-999e-56327bcaccfd tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:04.593404 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-fdb8c84e-8ea4-4dc6-a94d-5e21a15dc398 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.256606 Jul 01 16:42:04.595827 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 100/196] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:04 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:04.606127 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cd8ce2ac-6fc4-474e-999e-56327bcaccfd tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:04.607706 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cd8ce2ac-6fc4-474e-999e-56327bcaccfd tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:04.609339 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cd8ce2ac-6fc4-474e-999e-56327bcaccfd tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:04.609890 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cd8ce2ac-6fc4-474e-999e-56327bcaccfd tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:04.808886 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-cd8ce2ac-6fc4-474e-999e-56327bcaccfd tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:04.822091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-cd8ce2ac-6fc4-474e-999e-56327bcaccfd tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1314 microversion: 2.1 time: 0.241390 Jul 01 16:42:04.833235 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 97/197] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:04 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:05.284894 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c623c648-804f-4c16-b9bb-7ea3146c67da tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c2c6456-43d7-4866-a864-6e7095de2f11"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:05.286023 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c623c648-804f-4c16-b9bb-7ea3146c67da tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:05.294174 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c623c648-804f-4c16-b9bb-7ea3146c67da tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:05.295154 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c623c648-804f-4c16-b9bb-7ea3146c67da tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:05.296390 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c623c648-804f-4c16-b9bb-7ea3146c67da tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:05.298924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c623c648-804f-4c16-b9bb-7ea3146c67da tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:05.500557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-84fdb522-5bb5-4a85-9536-eb3a6c7b7135 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:05.501365 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-84fdb522-5bb5-4a85-9536-eb3a6c7b7135 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:05.507722 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:05.508416 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=8 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:05.509293 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:05.511694 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-84fdb522-5bb5-4a85-9536-eb3a6c7b7135 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:05.512444 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-84fdb522-5bb5-4a85-9536-eb3a6c7b7135 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:05.513845 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-84fdb522-5bb5-4a85-9536-eb3a6c7b7135 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:05.514540 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-84fdb522-5bb5-4a85-9536-eb3a6c7b7135 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:05.577057 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:05.670258 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-84fdb522-5bb5-4a85-9536-eb3a6c7b7135 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:05.679698 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-84fdb522-5bb5-4a85-9536-eb3a6c7b7135 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.183499 Jul 01 16:42:05.680381 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 98/198] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:05 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:05.694266 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-df4aa131-8088-4db2-bda3-2f1aead76a0a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:05.695242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-df4aa131-8088-4db2-bda3-2f1aead76a0a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:05.702318 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-df4aa131-8088-4db2-bda3-2f1aead76a0a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:05.703115 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-df4aa131-8088-4db2-bda3-2f1aead76a0a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:05.704858 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-df4aa131-8088-4db2-bda3-2f1aead76a0a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:05.705514 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-df4aa131-8088-4db2-bda3-2f1aead76a0a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:05.907958 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=12 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:05.918567 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-df4aa131-8088-4db2-bda3-2f1aead76a0a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:05.927920 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-df4aa131-8088-4db2-bda3-2f1aead76a0a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.245684 Jul 01 16:42:05.939587 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 99/199] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:05 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:05.946505 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ca19b379-2064-4112-850b-23977814d39a tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:05.947568 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ca19b379-2064-4112-850b-23977814d39a tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:05.956522 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ca19b379-2064-4112-850b-23977814d39a tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:05.957472 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ca19b379-2064-4112-850b-23977814d39a tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:05.958537 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ca19b379-2064-4112-850b-23977814d39a tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:05.960571 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ca19b379-2064-4112-850b-23977814d39a tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:06.221795 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ca19b379-2064-4112-850b-23977814d39a tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:06.237370 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ca19b379-2064-4112-850b-23977814d39a tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1314 microversion: 2.1 time: 0.295606 Jul 01 16:42:06.239193 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 100/200] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:05 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:06.700847 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c775fe10-ff70-439f-847e-dd2cea851aa8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:06.701426 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c775fe10-ff70-439f-847e-dd2cea851aa8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:06.713159 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c775fe10-ff70-439f-847e-dd2cea851aa8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:06.713601 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c775fe10-ff70-439f-847e-dd2cea851aa8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:06.714411 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c775fe10-ff70-439f-847e-dd2cea851aa8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:06.714848 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c775fe10-ff70-439f-847e-dd2cea851aa8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:06.743259 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c775fe10-ff70-439f-847e-dd2cea851aa8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c/ips" status: 200 len: 150 microversion: 2.20 time: 0.055748 Jul 01 16:42:06.744364 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 101/201] 10.222.0.57 () {60 vars in 1288 bytes} [Fri Jul 1 16:42:06 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c/ips => generated 150 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 16:42:06.749811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-30e17871-8582-4274-ab41-580f5a5b71e1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:06.752112 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-30e17871-8582-4274-ab41-580f5a5b71e1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:06.759421 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-30e17871-8582-4274-ab41-580f5a5b71e1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:06.760043 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-30e17871-8582-4274-ab41-580f5a5b71e1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:06.761008 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-30e17871-8582-4274-ab41-580f5a5b71e1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:06.761785 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-30e17871-8582-4274-ab41-580f5a5b71e1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:06.785928 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:06.958426 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-30e17871-8582-4274-ab41-580f5a5b71e1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:06.974950 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-30e17871-8582-4274-ab41-580f5a5b71e1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.227001 Jul 01 16:42:06.976504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 102/202] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:06 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:06.984115 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f7c4865c-f7d7-4a40-901a-954678dc2c18 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:06.985743 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f7c4865c-f7d7-4a40-901a-954678dc2c18 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:06.995527 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f7c4865c-f7d7-4a40-901a-954678dc2c18 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:06.996291 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f7c4865c-f7d7-4a40-901a-954678dc2c18 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:06.997935 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f7c4865c-f7d7-4a40-901a-954678dc2c18 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:06.998709 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f7c4865c-f7d7-4a40-901a-954678dc2c18 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:07.382165 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f7c4865c-f7d7-4a40-901a-954678dc2c18 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:07.399954 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f7c4865c-f7d7-4a40-901a-954678dc2c18 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.418418 Jul 01 16:42:07.399954 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 103/203] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:06 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:07.409475 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d65ab0a4-924c-483f-8de0-0b6d798da97b tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:07.410097 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d65ab0a4-924c-483f-8de0-0b6d798da97b tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:07.426306 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d65ab0a4-924c-483f-8de0-0b6d798da97b tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:07.427080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d65ab0a4-924c-483f-8de0-0b6d798da97b tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:07.432064 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d65ab0a4-924c-483f-8de0-0b6d798da97b tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:07.432514 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d65ab0a4-924c-483f-8de0-0b6d798da97b tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:07.654547 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d65ab0a4-924c-483f-8de0-0b6d798da97b tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:07.663495 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d65ab0a4-924c-483f-8de0-0b6d798da97b tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1314 microversion: 2.1 time: 0.259363 Jul 01 16:42:07.676559 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 104/204] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:07 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:07.993226 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a058990e-feae-4205-923c-1b415641844e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:07.993928 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a058990e-feae-4205-923c-1b415641844e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:08.002488 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a058990e-feae-4205-923c-1b415641844e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:08.003223 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a058990e-feae-4205-923c-1b415641844e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:08.004650 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a058990e-feae-4205-923c-1b415641844e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:08.005331 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a058990e-feae-4205-923c-1b415641844e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:08.302772 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a058990e-feae-4205-923c-1b415641844e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:08.314595 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a058990e-feae-4205-923c-1b415641844e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.324826 Jul 01 16:42:08.316081 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 105/205] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:07 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:08.414995 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-45a0b9ad-377b-4aad-8865-ad4e8631d3c1 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:08.415617 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-45a0b9ad-377b-4aad-8865-ad4e8631d3c1 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:08.424270 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-45a0b9ad-377b-4aad-8865-ad4e8631d3c1 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:08.425829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-45a0b9ad-377b-4aad-8865-ad4e8631d3c1 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:08.427375 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-45a0b9ad-377b-4aad-8865-ad4e8631d3c1 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:08.428047 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-45a0b9ad-377b-4aad-8865-ad4e8631d3c1 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:08.580562 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-45a0b9ad-377b-4aad-8865-ad4e8631d3c1 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:08.588501 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-45a0b9ad-377b-4aad-8865-ad4e8631d3c1 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.176962 Jul 01 16:42:08.589081 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 106/206] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:08 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:08.690808 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9ff93316-695f-4290-9ca9-f6f80189cede tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:08.691539 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9ff93316-695f-4290-9ca9-f6f80189cede tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:08.697790 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ff93316-695f-4290-9ca9-f6f80189cede tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:08.698310 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ff93316-695f-4290-9ca9-f6f80189cede tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:08.699347 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ff93316-695f-4290-9ca9-f6f80189cede tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:08.699777 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ff93316-695f-4290-9ca9-f6f80189cede tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:08.849142 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9ff93316-695f-4290-9ca9-f6f80189cede tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:08.857331 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9ff93316-695f-4290-9ca9-f6f80189cede tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1314 microversion: 2.1 time: 0.171990 Jul 01 16:42:08.858270 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 107/207] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:08 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:09.333775 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a982be1b-fc70-4cd7-9e40-08bc4982738f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:09.335551 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a982be1b-fc70-4cd7-9e40-08bc4982738f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:09.346336 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a982be1b-fc70-4cd7-9e40-08bc4982738f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:09.346816 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a982be1b-fc70-4cd7-9e40-08bc4982738f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:09.347612 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a982be1b-fc70-4cd7-9e40-08bc4982738f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:09.348052 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a982be1b-fc70-4cd7-9e40-08bc4982738f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:09.527161 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c623c648-804f-4c16-b9bb-7ea3146c67da tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "POST /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.246536 Jul 01 16:42:09.528651 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 101/208] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 1 16:42:05 2022] POST /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e/os-volume_attachments => generated 194 bytes in 4250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:42:09.559903 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4f63bd0b-4edc-4216-b19b-ed2c567ee819 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:09.565019 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4f63bd0b-4edc-4216-b19b-ed2c567ee819 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:09.583170 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4f63bd0b-4edc-4216-b19b-ed2c567ee819 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:09.583638 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4f63bd0b-4edc-4216-b19b-ed2c567ee819 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:09.584435 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4f63bd0b-4edc-4216-b19b-ed2c567ee819 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:09.585135 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4f63bd0b-4edc-4216-b19b-ed2c567ee819 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:09.649805 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-4f63bd0b-4edc-4216-b19b-ed2c567ee819 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lazy-loading 'flavor' on Instance uuid 8498c0a8-d20e-4261-a0a1-d4c33004141c {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:42:09.679249 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a982be1b-fc70-4cd7-9e40-08bc4982738f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:09.697080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a982be1b-fc70-4cd7-9e40-08bc4982738f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.366194 Jul 01 16:42:09.701591 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 108/209] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:09 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:09.716881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-29475563-0c46-4bc7-8a2a-e43a378031b7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:09.723209 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-29475563-0c46-4bc7-8a2a-e43a378031b7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:09.746941 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-29475563-0c46-4bc7-8a2a-e43a378031b7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:09.747400 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-29475563-0c46-4bc7-8a2a-e43a378031b7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:09.748193 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-29475563-0c46-4bc7-8a2a-e43a378031b7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:09.761286 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-29475563-0c46-4bc7-8a2a-e43a378031b7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:10.054841 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-29475563-0c46-4bc7-8a2a-e43a378031b7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:10.066325 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-29475563-0c46-4bc7-8a2a-e43a378031b7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.363401 Jul 01 16:42:10.067288 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 109/210] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:09 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:10.074750 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fdd73f2c-c366-4276-9aed-64e38214cac9 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:10.075566 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-fdd73f2c-c366-4276-9aed-64e38214cac9 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:10.098337 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fdd73f2c-c366-4276-9aed-64e38214cac9 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:10.099097 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fdd73f2c-c366-4276-9aed-64e38214cac9 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:10.100046 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fdd73f2c-c366-4276-9aed-64e38214cac9 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:10.101420 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fdd73f2c-c366-4276-9aed-64e38214cac9 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:10.232595 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4f63bd0b-4edc-4216-b19b-ed2c567ee819 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "POST /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c/action" status: 202 len: 0 microversion: 2.20 time: 0.684465 Jul 01 16:42:10.237414 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 102/211] 10.222.0.57 () {62 vars in 1318 bytes} [Fri Jul 1 16:42:09 2022] POST /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c/action => generated 0 bytes in 691 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 16:42:10.249430 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4c927201-3ab7-4dae-ad0c-f9b0b9a63a93 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:10.254103 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4c927201-3ab7-4dae-ad0c-f9b0b9a63a93 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:10.279649 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4c927201-3ab7-4dae-ad0c-f9b0b9a63a93 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:10.282059 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4c927201-3ab7-4dae-ad0c-f9b0b9a63a93 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:10.283583 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4c927201-3ab7-4dae-ad0c-f9b0b9a63a93 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:10.286597 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4c927201-3ab7-4dae-ad0c-f9b0b9a63a93 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:10.354952 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fdd73f2c-c366-4276-9aed-64e38214cac9 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:10.383880 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fdd73f2c-c366-4276-9aed-64e38214cac9 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1314 microversion: 2.1 time: 0.310317 Jul 01 16:42:10.385100 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 110/212] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:10 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:10.513630 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-a9ef89f0-d62d-4674-b9ef-6884173297e2 req-fdc797c8-36fc-4c4e-8bb9-258d2194c66b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86c56d1d-53f0-469d-8f06-f34ae6c6cf40", "tag": "ea5701c7-2fd8-4a27-843f-6febced6bafb"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:10.530427 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-a9ef89f0-d62d-4674-b9ef-6884173297e2 req-fdc797c8-36fc-4c4e-8bb9-258d2194c66b service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:10.532410 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-a9ef89f0-d62d-4674-b9ef-6884173297e2 req-fdc797c8-36fc-4c4e-8bb9-258d2194c66b service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:10.560141 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-a9ef89f0-d62d-4674-b9ef-6884173297e2 req-fdc797c8-36fc-4c4e-8bb9-258d2194c66b service nova] Creating event network-changed:ea5701c7-2fd8-4a27-843f-6febced6bafb for instance 86c56d1d-53f0-469d-8f06-f34ae6c6cf40 on hv-cinder-79760 Jul 01 16:42:10.566771 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-a9ef89f0-d62d-4674-b9ef-6884173297e2 req-fdc797c8-36fc-4c4e-8bb9-258d2194c66b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060921 Jul 01 16:42:10.567856 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 111/213] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:42:10.582854 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4c927201-3ab7-4dae-ad0c-f9b0b9a63a93 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:10.591484 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4c927201-3ab7-4dae-ad0c-f9b0b9a63a93 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:10.592983 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4c927201-3ab7-4dae-ad0c-f9b0b9a63a93 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:10.594819 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4c927201-3ab7-4dae-ad0c-f9b0b9a63a93 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1721 microversion: 2.20 time: 0.351842 Jul 01 16:42:10.595393 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 103/214] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:10 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1721 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:10.715510 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2284c237-e11f-40fc-a2a3-be867809ba01 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:10.716702 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2284c237-e11f-40fc-a2a3-be867809ba01 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:10.724712 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2284c237-e11f-40fc-a2a3-be867809ba01 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:10.725672 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2284c237-e11f-40fc-a2a3-be867809ba01 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:10.726797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2284c237-e11f-40fc-a2a3-be867809ba01 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:10.727425 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2284c237-e11f-40fc-a2a3-be867809ba01 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:10.943360 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2284c237-e11f-40fc-a2a3-be867809ba01 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:10.955392 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2284c237-e11f-40fc-a2a3-be867809ba01 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.243283 Jul 01 16:42:10.956354 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 112/215] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:10 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:11.089283 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3e49577a-d3f8-439d-aa9b-1cd0d8db420e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:11.091533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3e49577a-d3f8-439d-aa9b-1cd0d8db420e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:11.103710 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3e49577a-d3f8-439d-aa9b-1cd0d8db420e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:11.104452 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3e49577a-d3f8-439d-aa9b-1cd0d8db420e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:11.106293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3e49577a-d3f8-439d-aa9b-1cd0d8db420e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:11.107853 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3e49577a-d3f8-439d-aa9b-1cd0d8db420e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:11.150126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:11.306318 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3e49577a-d3f8-439d-aa9b-1cd0d8db420e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:11.314293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3e49577a-d3f8-439d-aa9b-1cd0d8db420e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.233148 Jul 01 16:42:11.314896 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 104/216] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:11 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:11.402544 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-acaa8929-1719-4866-9f59-5393f5a0f163 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:11.403161 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-acaa8929-1719-4866-9f59-5393f5a0f163 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:11.410563 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-acaa8929-1719-4866-9f59-5393f5a0f163 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:11.411025 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-acaa8929-1719-4866-9f59-5393f5a0f163 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:11.411793 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-acaa8929-1719-4866-9f59-5393f5a0f163 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:11.412235 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-acaa8929-1719-4866-9f59-5393f5a0f163 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:11.556270 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-acaa8929-1719-4866-9f59-5393f5a0f163 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:11.564893 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-acaa8929-1719-4866-9f59-5393f5a0f163 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1314 microversion: 2.1 time: 0.166142 Jul 01 16:42:11.565472 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 113/217] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:11 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:11.614264 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0144e317-4190-4594-bf84-7a24e80d7760 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:11.615502 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0144e317-4190-4594-bf84-7a24e80d7760 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:11.622204 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0144e317-4190-4594-bf84-7a24e80d7760 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:11.622696 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0144e317-4190-4594-bf84-7a24e80d7760 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:11.623474 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0144e317-4190-4594-bf84-7a24e80d7760 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:11.623984 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0144e317-4190-4594-bf84-7a24e80d7760 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:11.766137 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0144e317-4190-4594-bf84-7a24e80d7760 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:11.774435 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0144e317-4190-4594-bf84-7a24e80d7760 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:11.776034 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0144e317-4190-4594-bf84-7a24e80d7760 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:11.777261 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0144e317-4190-4594-bf84-7a24e80d7760 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1721 microversion: 2.20 time: 0.167262 Jul 01 16:42:11.777813 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 105/218] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:11 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:11.975085 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6a91647d-d27c-436f-8e86-f0ab0322a53e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:11.975706 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6a91647d-d27c-436f-8e86-f0ab0322a53e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:11.981942 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6a91647d-d27c-436f-8e86-f0ab0322a53e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:11.982421 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6a91647d-d27c-436f-8e86-f0ab0322a53e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:11.983201 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6a91647d-d27c-436f-8e86-f0ab0322a53e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:11.983643 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6a91647d-d27c-436f-8e86-f0ab0322a53e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:12.117115 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6a91647d-d27c-436f-8e86-f0ab0322a53e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:12.124546 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6a91647d-d27c-436f-8e86-f0ab0322a53e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.153340 Jul 01 16:42:12.126023 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 114/219] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:11 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:12.331669 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1b7a0ce5-d716-4d96-9d0a-8b585c037d39 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:12.332278 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1b7a0ce5-d716-4d96-9d0a-8b585c037d39 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:12.340011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1b7a0ce5-d716-4d96-9d0a-8b585c037d39 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:12.340466 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1b7a0ce5-d716-4d96-9d0a-8b585c037d39 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:12.341313 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1b7a0ce5-d716-4d96-9d0a-8b585c037d39 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:12.341773 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1b7a0ce5-d716-4d96-9d0a-8b585c037d39 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:12.486479 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1b7a0ce5-d716-4d96-9d0a-8b585c037d39 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:12.493850 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1b7a0ce5-d716-4d96-9d0a-8b585c037d39 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.166137 Jul 01 16:42:12.494430 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 106/220] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:12 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:12.582494 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ad0b7346-dc09-4e6c-b143-dfebf60f8583 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:12.583110 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ad0b7346-dc09-4e6c-b143-dfebf60f8583 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:12.590179 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ad0b7346-dc09-4e6c-b143-dfebf60f8583 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:12.590661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ad0b7346-dc09-4e6c-b143-dfebf60f8583 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:12.591441 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ad0b7346-dc09-4e6c-b143-dfebf60f8583 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:12.591880 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ad0b7346-dc09-4e6c-b143-dfebf60f8583 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:12.727125 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ad0b7346-dc09-4e6c-b143-dfebf60f8583 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:12.734689 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ad0b7346-dc09-4e6c-b143-dfebf60f8583 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1314 microversion: 2.1 time: 0.156342 Jul 01 16:42:12.735281 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 115/221] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:12 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:12.796738 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f163b1eb-78a5-45ef-aea1-109679f2e624 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:12.797458 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f163b1eb-78a5-45ef-aea1-109679f2e624 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:12.803687 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f163b1eb-78a5-45ef-aea1-109679f2e624 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:12.804129 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f163b1eb-78a5-45ef-aea1-109679f2e624 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:12.804892 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f163b1eb-78a5-45ef-aea1-109679f2e624 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:12.805349 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f163b1eb-78a5-45ef-aea1-109679f2e624 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:12.937800 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f163b1eb-78a5-45ef-aea1-109679f2e624 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:12.945811 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f163b1eb-78a5-45ef-aea1-109679f2e624 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:12.947387 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f163b1eb-78a5-45ef-aea1-109679f2e624 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:12.948518 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f163b1eb-78a5-45ef-aea1-109679f2e624 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1721 microversion: 2.20 time: 0.155666 Jul 01 16:42:12.949071 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 107/222] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:12 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:13.142988 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-85147e02-a294-43bf-8771-d3119b95eefb tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:13.143597 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-85147e02-a294-43bf-8771-d3119b95eefb tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:13.149624 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-85147e02-a294-43bf-8771-d3119b95eefb tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:13.150073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-85147e02-a294-43bf-8771-d3119b95eefb tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:13.150868 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-85147e02-a294-43bf-8771-d3119b95eefb tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:13.151309 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-85147e02-a294-43bf-8771-d3119b95eefb tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:13.286518 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-85147e02-a294-43bf-8771-d3119b95eefb tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:13.293959 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-85147e02-a294-43bf-8771-d3119b95eefb tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.155441 Jul 01 16:42:13.294490 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 116/223] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:13 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:13.511791 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8c41b722-b7b8-47ae-a504-7e4c26cf6b1a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:13.512398 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8c41b722-b7b8-47ae-a504-7e4c26cf6b1a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:13.519063 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8c41b722-b7b8-47ae-a504-7e4c26cf6b1a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:13.519587 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8c41b722-b7b8-47ae-a504-7e4c26cf6b1a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:13.520337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8c41b722-b7b8-47ae-a504-7e4c26cf6b1a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:13.520966 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8c41b722-b7b8-47ae-a504-7e4c26cf6b1a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:13.665502 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8c41b722-b7b8-47ae-a504-7e4c26cf6b1a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:13.673991 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8c41b722-b7b8-47ae-a504-7e4c26cf6b1a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.166042 Jul 01 16:42:13.674610 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 108/224] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:13 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:13.751503 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b6d87278-c53c-44d6-a789-a886a2592ffc tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:13.752123 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b6d87278-c53c-44d6-a789-a886a2592ffc tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:13.758559 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b6d87278-c53c-44d6-a789-a886a2592ffc tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:13.758997 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b6d87278-c53c-44d6-a789-a886a2592ffc tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:13.759749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b6d87278-c53c-44d6-a789-a886a2592ffc tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:13.760177 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b6d87278-c53c-44d6-a789-a886a2592ffc tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:13.901197 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b6d87278-c53c-44d6-a789-a886a2592ffc tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:13.909239 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b6d87278-c53c-44d6-a789-a886a2592ffc tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1314 microversion: 2.1 time: 0.161716 Jul 01 16:42:13.909804 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 117/225] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:13 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:13.967163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f30d7139-9f01-41ef-9f22-ac0a7a920987 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:13.967770 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f30d7139-9f01-41ef-9f22-ac0a7a920987 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:13.974787 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f30d7139-9f01-41ef-9f22-ac0a7a920987 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:13.975236 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f30d7139-9f01-41ef-9f22-ac0a7a920987 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:13.975996 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f30d7139-9f01-41ef-9f22-ac0a7a920987 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:13.976436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f30d7139-9f01-41ef-9f22-ac0a7a920987 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:14.113514 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f30d7139-9f01-41ef-9f22-ac0a7a920987 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:14.121743 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f30d7139-9f01-41ef-9f22-ac0a7a920987 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:14.123291 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f30d7139-9f01-41ef-9f22-ac0a7a920987 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:14.124443 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f30d7139-9f01-41ef-9f22-ac0a7a920987 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1721 microversion: 2.20 time: 0.161158 Jul 01 16:42:14.125115 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 109/226] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:13 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:14.311634 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e827635b-cac9-4250-a5bb-0315e4ed5347 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:14.312417 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e827635b-cac9-4250-a5bb-0315e4ed5347 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:14.318451 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e827635b-cac9-4250-a5bb-0315e4ed5347 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:14.318901 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e827635b-cac9-4250-a5bb-0315e4ed5347 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:14.319665 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e827635b-cac9-4250-a5bb-0315e4ed5347 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:14.320105 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e827635b-cac9-4250-a5bb-0315e4ed5347 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:14.464787 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e827635b-cac9-4250-a5bb-0315e4ed5347 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:14.473381 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e827635b-cac9-4250-a5bb-0315e4ed5347 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.165486 Jul 01 16:42:14.473943 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 118/227] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:14 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:14.691798 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-313d0e48-b7c7-42e8-ab37-e38e105c31e5 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:14.692326 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-313d0e48-b7c7-42e8-ab37-e38e105c31e5 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:14.698332 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-313d0e48-b7c7-42e8-ab37-e38e105c31e5 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:14.698790 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-313d0e48-b7c7-42e8-ab37-e38e105c31e5 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:14.699543 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-313d0e48-b7c7-42e8-ab37-e38e105c31e5 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:14.699977 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-313d0e48-b7c7-42e8-ab37-e38e105c31e5 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:14.828622 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-313d0e48-b7c7-42e8-ab37-e38e105c31e5 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:14.836517 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-313d0e48-b7c7-42e8-ab37-e38e105c31e5 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.149459 Jul 01 16:42:14.837085 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 110/228] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:14 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:14.924678 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-7a507673-ddb7-44ee-ba8f-16014d453733 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:14.925283 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-7a507673-ddb7-44ee-ba8f-16014d453733 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:14.931778 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7a507673-ddb7-44ee-ba8f-16014d453733 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:14.932216 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7a507673-ddb7-44ee-ba8f-16014d453733 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:14.932966 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7a507673-ddb7-44ee-ba8f-16014d453733 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:14.933396 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7a507673-ddb7-44ee-ba8f-16014d453733 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:15.065717 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7a507673-ddb7-44ee-ba8f-16014d453733 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:15.069286 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=100 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:15.073982 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-7a507673-ddb7-44ee-ba8f-16014d453733 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1314 microversion: 2.1 time: 0.153035 Jul 01 16:42:15.074593 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 119/229] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:14 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:15.143521 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-060c31a3-3f6c-4698-ab77-6174aa34e85a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:15.144116 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-060c31a3-3f6c-4698-ab77-6174aa34e85a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:15.150579 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-060c31a3-3f6c-4698-ab77-6174aa34e85a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:15.151018 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-060c31a3-3f6c-4698-ab77-6174aa34e85a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:15.151764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-060c31a3-3f6c-4698-ab77-6174aa34e85a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:15.152191 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-060c31a3-3f6c-4698-ab77-6174aa34e85a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:15.281466 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-060c31a3-3f6c-4698-ab77-6174aa34e85a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:15.289503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-060c31a3-3f6c-4698-ab77-6174aa34e85a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:15.291009 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-060c31a3-3f6c-4698-ab77-6174aa34e85a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:15.292148 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-060c31a3-3f6c-4698-ab77-6174aa34e85a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1721 microversion: 2.20 time: 0.153234 Jul 01 16:42:15.292696 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 111/230] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:15 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:15.490751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-94ee5201-4658-41f0-9e32-24a9fffd49e6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:15.491370 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-94ee5201-4658-41f0-9e32-24a9fffd49e6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:15.497361 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-94ee5201-4658-41f0-9e32-24a9fffd49e6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:15.497814 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-94ee5201-4658-41f0-9e32-24a9fffd49e6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:15.498624 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-94ee5201-4658-41f0-9e32-24a9fffd49e6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:15.503692 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-94ee5201-4658-41f0-9e32-24a9fffd49e6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:15.634766 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-94ee5201-4658-41f0-9e32-24a9fffd49e6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:15.642261 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-94ee5201-4658-41f0-9e32-24a9fffd49e6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.155628 Jul 01 16:42:15.642860 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 120/231] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:15 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:15.853359 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b90ca93f-37ea-4019-a2a4-717b5aee6bdb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:15.854014 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b90ca93f-37ea-4019-a2a4-717b5aee6bdb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:15.861490 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b90ca93f-37ea-4019-a2a4-717b5aee6bdb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:15.861934 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b90ca93f-37ea-4019-a2a4-717b5aee6bdb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:15.862727 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b90ca93f-37ea-4019-a2a4-717b5aee6bdb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:15.863417 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b90ca93f-37ea-4019-a2a4-717b5aee6bdb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:16.004004 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b90ca93f-37ea-4019-a2a4-717b5aee6bdb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:16.011939 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b90ca93f-37ea-4019-a2a4-717b5aee6bdb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.162797 Jul 01 16:42:16.012507 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 112/232] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:15 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:16.092202 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cae696c5-e5df-41c7-9f29-5b1f40e768f3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:16.092816 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-cae696c5-e5df-41c7-9f29-5b1f40e768f3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:16.100140 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cae696c5-e5df-41c7-9f29-5b1f40e768f3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:16.100640 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cae696c5-e5df-41c7-9f29-5b1f40e768f3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:16.101362 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cae696c5-e5df-41c7-9f29-5b1f40e768f3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:16.101797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cae696c5-e5df-41c7-9f29-5b1f40e768f3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:16.235605 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-cae696c5-e5df-41c7-9f29-5b1f40e768f3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:16.242953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-cae696c5-e5df-41c7-9f29-5b1f40e768f3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1314 microversion: 2.1 time: 0.155488 Jul 01 16:42:16.243514 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 121/233] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:16 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:16.310489 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-47c03d18-a193-4be7-a3fd-d9fc5856d91b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:16.311093 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-47c03d18-a193-4be7-a3fd-d9fc5856d91b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:16.318704 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-47c03d18-a193-4be7-a3fd-d9fc5856d91b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:16.319151 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-47c03d18-a193-4be7-a3fd-d9fc5856d91b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:16.319908 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-47c03d18-a193-4be7-a3fd-d9fc5856d91b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:16.320340 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-47c03d18-a193-4be7-a3fd-d9fc5856d91b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:16.455033 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-47c03d18-a193-4be7-a3fd-d9fc5856d91b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:16.463201 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-47c03d18-a193-4be7-a3fd-d9fc5856d91b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:16.464698 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-47c03d18-a193-4be7-a3fd-d9fc5856d91b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:16.465840 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-47c03d18-a193-4be7-a3fd-d9fc5856d91b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1721 microversion: 2.20 time: 0.159278 Jul 01 16:42:16.466906 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 113/234] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:16 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:16.663566 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2047c291-611b-49bb-b0a7-8a665fedb9f1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:16.663566 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2047c291-611b-49bb-b0a7-8a665fedb9f1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:16.666851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2047c291-611b-49bb-b0a7-8a665fedb9f1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:16.667307 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2047c291-611b-49bb-b0a7-8a665fedb9f1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:16.668386 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2047c291-611b-49bb-b0a7-8a665fedb9f1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:16.668595 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2047c291-611b-49bb-b0a7-8a665fedb9f1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:16.810008 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2047c291-611b-49bb-b0a7-8a665fedb9f1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:16.818542 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2047c291-611b-49bb-b0a7-8a665fedb9f1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.163435 Jul 01 16:42:16.819123 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 122/235] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:16 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:17.028758 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1686e3f5-c75c-4633-989d-a9a4b15cdee6 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:17.029367 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1686e3f5-c75c-4633-989d-a9a4b15cdee6 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:17.042475 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1686e3f5-c75c-4633-989d-a9a4b15cdee6 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:17.042929 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1686e3f5-c75c-4633-989d-a9a4b15cdee6 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:17.043718 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1686e3f5-c75c-4633-989d-a9a4b15cdee6 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:17.044145 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1686e3f5-c75c-4633-989d-a9a4b15cdee6 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:17.099121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-e9ed7bbe-dfd8-4aff-bbc9-172b9126fad9 req-a4230bb0-282b-4c4d-9fa0-6c16ec8fa896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c56d1d-53f0-469d-8f06-f34ae6c6cf40", "name": "network-vif-plugged", "status": "completed", "tag": "ea5701c7-2fd8-4a27-843f-6febced6bafb"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:17.112180 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-e9ed7bbe-dfd8-4aff-bbc9-172b9126fad9 req-a4230bb0-282b-4c4d-9fa0-6c16ec8fa896 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:17.112750 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-e9ed7bbe-dfd8-4aff-bbc9-172b9126fad9 req-a4230bb0-282b-4c4d-9fa0-6c16ec8fa896 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:17.133159 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-e9ed7bbe-dfd8-4aff-bbc9-172b9126fad9 req-a4230bb0-282b-4c4d-9fa0-6c16ec8fa896 service nova] Creating event network-vif-plugged:ea5701c7-2fd8-4a27-843f-6febced6bafb for instance 86c56d1d-53f0-469d-8f06-f34ae6c6cf40 on hv-cinder-79760 Jul 01 16:42:17.141463 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-e9ed7bbe-dfd8-4aff-bbc9-172b9126fad9 req-a4230bb0-282b-4c4d-9fa0-6c16ec8fa896 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046214 Jul 01 16:42:17.142826 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 123/236] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:42:17.184601 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-dc318e99-5b50-4737-9f81-fd850cb6d509 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Action: 'create', calling method: .version_select at 0x7fa85f51cf70>, body: {"keypair": {"name": "tempest-keypair-920149996", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNspK3lGemeP5QrVl7g2qklrgqrn/VBTeGdkbpXxzZmuRld889K6i3kP3XSF4GyVduNaSCiODU2xhXHHIzuJotnIeBSH2RFHgIQOFkcCfi2/0BaXQOOh55yXpt84yHoRTA=="}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:17.200010 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-dc318e99-5b50-4737-9f81-fd850cb6d509 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Getting quotas for project 5747a83d930f4075a78e9b14abd58c7f. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:42:17.203898 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1686e3f5-c75c-4633-989d-a9a4b15cdee6 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:17.208215 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-dc318e99-5b50-4737-9f81-fd850cb6d509 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Getting quotas for user 7c4da21fbfa3472cac6e766a2f4799d8 and project 5747a83d930f4075a78e9b14abd58c7f. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:42:17.212165 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1686e3f5-c75c-4633-989d-a9a4b15cdee6 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.187131 Jul 01 16:42:17.214423 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 114/237] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:17 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:17.233255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-dc318e99-5b50-4737-9f81-fd850cb6d509 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052899 Jul 01 16:42:17.234401 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 124/238] 10.222.0.57 () {60 vars in 1158 bytes} [Fri Jul 1 16:42:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:42:17.260860 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6b8fed51-23eb-4a8b-a910-eeb2385c6bd2 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:17.261505 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6b8fed51-23eb-4a8b-a910-eeb2385c6bd2 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:17.268143 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6b8fed51-23eb-4a8b-a910-eeb2385c6bd2 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:17.268578 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6b8fed51-23eb-4a8b-a910-eeb2385c6bd2 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:17.269342 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6b8fed51-23eb-4a8b-a910-eeb2385c6bd2 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:17.269783 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6b8fed51-23eb-4a8b-a910-eeb2385c6bd2 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:17.466205 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6b8fed51-23eb-4a8b-a910-eeb2385c6bd2 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:17.476094 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6b8fed51-23eb-4a8b-a910-eeb2385c6bd2 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1314 microversion: 2.1 time: 0.218980 Jul 01 16:42:17.476972 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 115/239] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:17 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:17.484551 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-67e44680-d0b5-4f54-ac49-cbce1dc7eefd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:17.485251 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-67e44680-d0b5-4f54-ac49-cbce1dc7eefd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:17.491688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-67e44680-d0b5-4f54-ac49-cbce1dc7eefd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:17.492141 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-67e44680-d0b5-4f54-ac49-cbce1dc7eefd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:17.492920 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-67e44680-d0b5-4f54-ac49-cbce1dc7eefd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:17.493356 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-67e44680-d0b5-4f54-ac49-cbce1dc7eefd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:17.773568 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-67e44680-d0b5-4f54-ac49-cbce1dc7eefd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:17.783359 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-67e44680-d0b5-4f54-ac49-cbce1dc7eefd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:17.784885 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-67e44680-d0b5-4f54-ac49-cbce1dc7eefd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:17.786064 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-67e44680-d0b5-4f54-ac49-cbce1dc7eefd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1721 microversion: 2.20 time: 0.305692 Jul 01 16:42:17.786683 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 125/240] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:17 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1721 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:17.835284 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1df262bf-50f2-44fb-b583-e16f9e21ef79 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:17.835884 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1df262bf-50f2-44fb-b583-e16f9e21ef79 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:17.842257 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1df262bf-50f2-44fb-b583-e16f9e21ef79 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:17.842724 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1df262bf-50f2-44fb-b583-e16f9e21ef79 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:17.844010 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1df262bf-50f2-44fb-b583-e16f9e21ef79 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:17.844438 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1df262bf-50f2-44fb-b583-e16f9e21ef79 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:17.993627 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1df262bf-50f2-44fb-b583-e16f9e21ef79 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:18.001780 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1df262bf-50f2-44fb-b583-e16f9e21ef79 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.170592 Jul 01 16:42:18.002375 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 116/241] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:17 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:18.228974 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-55d9338d-c6b6-4a58-aa13-aa127a91726f tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:18.229588 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-55d9338d-c6b6-4a58-aa13-aa127a91726f tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:18.236006 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-55d9338d-c6b6-4a58-aa13-aa127a91726f tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:18.236460 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-55d9338d-c6b6-4a58-aa13-aa127a91726f tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:18.237239 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-55d9338d-c6b6-4a58-aa13-aa127a91726f tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:18.237682 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-55d9338d-c6b6-4a58-aa13-aa127a91726f tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:18.374144 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-55d9338d-c6b6-4a58-aa13-aa127a91726f tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:18.382397 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-55d9338d-c6b6-4a58-aa13-aa127a91726f tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.157305 Jul 01 16:42:18.383055 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 126/242] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:18 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:18.493215 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8288550f-5688-4910-8c7d-9c5d7e3b7a69 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:18.493831 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8288550f-5688-4910-8c7d-9c5d7e3b7a69 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:18.500952 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8288550f-5688-4910-8c7d-9c5d7e3b7a69 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:18.501400 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8288550f-5688-4910-8c7d-9c5d7e3b7a69 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:18.502167 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8288550f-5688-4910-8c7d-9c5d7e3b7a69 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:18.502628 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8288550f-5688-4910-8c7d-9c5d7e3b7a69 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:18.748037 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4333aa33-6d47-4395-88f0-ab67542ba507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2071312974", "imageRef": "42a4b1a9-dea6-4c87-a2c1-328b9c0c8558", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c5acd85f-f778-4915-8079-a3e9582e6528"}], "security_groups": [{"name": "tempest-securitygroup--242476290"}], "key_name": "tempest-keypair-920149996", "user_data": "}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:18.923482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8288550f-5688-4910-8c7d-9c5d7e3b7a69 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:18.928875 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-4333aa33-6d47-4395-88f0-ab67542ba507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] validate_networks() for [('c5acd85f-f778-4915-8079-a3e9582e6528', None, None, None, None, None)] {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 16:42:18.931122 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8288550f-5688-4910-8c7d-9c5d7e3b7a69 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1314 microversion: 2.1 time: 0.441770 Jul 01 16:42:18.931685 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 117/243] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:18 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:18.936184 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-182b10a4-6e5a-48f2-ab65-b436e56bd9d8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:18.936788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-182b10a4-6e5a-48f2-ab65-b436e56bd9d8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:18.943698 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-182b10a4-6e5a-48f2-ab65-b436e56bd9d8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:18.944144 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-182b10a4-6e5a-48f2-ab65-b436e56bd9d8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:18.944902 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-182b10a4-6e5a-48f2-ab65-b436e56bd9d8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:18.945333 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-182b10a4-6e5a-48f2-ab65-b436e56bd9d8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:19.164468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-182b10a4-6e5a-48f2-ab65-b436e56bd9d8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:19.172798 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-182b10a4-6e5a-48f2-ab65-b436e56bd9d8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:19.174509 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-182b10a4-6e5a-48f2-ab65-b436e56bd9d8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:19.175762 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-182b10a4-6e5a-48f2-ab65-b436e56bd9d8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1721 microversion: 2.20 time: 0.243166 Jul 01 16:42:19.176425 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 118/244] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:18 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:19.181779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-60d668cc-bd38-4ad0-a7c3-744cb8e8a080 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:19.182674 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-60d668cc-bd38-4ad0-a7c3-744cb8e8a080 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:19.189630 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-60d668cc-bd38-4ad0-a7c3-744cb8e8a080 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:19.190080 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-60d668cc-bd38-4ad0-a7c3-744cb8e8a080 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:19.191045 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-60d668cc-bd38-4ad0-a7c3-744cb8e8a080 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:19.191482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-60d668cc-bd38-4ad0-a7c3-744cb8e8a080 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:19.427348 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-60d668cc-bd38-4ad0-a7c3-744cb8e8a080 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:19.434784 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-60d668cc-bd38-4ad0-a7c3-744cb8e8a080 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.256519 Jul 01 16:42:19.435375 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 119/245] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:19 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:19.440039 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c633f1a0-f245-4619-805d-c151fecc1649 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:19.440651 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c633f1a0-f245-4619-805d-c151fecc1649 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:19.446911 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c633f1a0-f245-4619-805d-c151fecc1649 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:19.447362 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c633f1a0-f245-4619-805d-c151fecc1649 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:19.448130 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c633f1a0-f245-4619-805d-c151fecc1649 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:19.448564 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c633f1a0-f245-4619-805d-c151fecc1649 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:19.454697 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-4333aa33-6d47-4395-88f0-ab67542ba507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 16:42:19.455322 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-4333aa33-6d47-4395-88f0-ab67542ba507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 16:42:19.455808 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-4333aa33-6d47-4395-88f0-ab67542ba507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 16:42:19.456222 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-4333aa33-6d47-4395-88f0-ab67542ba507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 16:42:19.456639 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-4333aa33-6d47-4395-88f0-ab67542ba507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 16:42:19.465823 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4333aa33-6d47-4395-88f0-ab67542ba507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:19.466274 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4333aa33-6d47-4395-88f0-ab67542ba507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:19.467113 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4333aa33-6d47-4395-88f0-ab67542ba507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:19.467554 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4333aa33-6d47-4395-88f0-ab67542ba507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:19.485020 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-4333aa33-6d47-4395-88f0-ab67542ba507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Getting quotas for project 5747a83d930f4075a78e9b14abd58c7f. Resources: {'ram', 'cores', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:42:19.489062 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-4333aa33-6d47-4395-88f0-ab67542ba507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Getting quotas for user 7c4da21fbfa3472cac6e766a2f4799d8 and project 5747a83d930f4075a78e9b14abd58c7f. Resources: {'ram', 'cores', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:42:19.500539 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4333aa33-6d47-4395-88f0-ab67542ba507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 16:42:19.502841 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4333aa33-6d47-4395-88f0-ab67542ba507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42a4b1a9-dea6-4c87-a2c1-328b9c0c8558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 16:42:19.551121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4333aa33-6d47-4395-88f0-ab67542ba507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.807305 Jul 01 16:42:19.551924 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 127/246] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 1 16:42:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 16:42:19.562675 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f5f3d4ad-ecbb-4c65-80be-981000225b93 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:19.563216 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f5f3d4ad-ecbb-4c65-80be-981000225b93 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:19.591771 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c633f1a0-f245-4619-805d-c151fecc1649 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:19.600318 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c633f1a0-f245-4619-805d-c151fecc1649 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.163837 Jul 01 16:42:19.601421 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 120/247] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:19 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:19.621909 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f5f3d4ad-ecbb-4c65-80be-981000225b93 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:19.629590 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f5f3d4ad-ecbb-4c65-80be-981000225b93 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1241 microversion: 2.1 time: 0.071604 Jul 01 16:42:19.630381 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 128/248] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:19 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:19.948633 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a87e8a27-ad88-44b1-8d63-bccdaab75c33 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:19.949517 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a87e8a27-ad88-44b1-8d63-bccdaab75c33 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:19.956118 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a87e8a27-ad88-44b1-8d63-bccdaab75c33 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:19.956561 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a87e8a27-ad88-44b1-8d63-bccdaab75c33 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:19.957377 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a87e8a27-ad88-44b1-8d63-bccdaab75c33 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:19.958385 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a87e8a27-ad88-44b1-8d63-bccdaab75c33 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:19.963063 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=100 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:20.098482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a87e8a27-ad88-44b1-8d63-bccdaab75c33 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:20.105852 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a87e8a27-ad88-44b1-8d63-bccdaab75c33 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1314 microversion: 2.1 time: 0.161713 Jul 01 16:42:20.106440 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 121/249] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:19 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:20.193740 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-284313b9-7c22-4019-832d-fd4e5f775873 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:20.194585 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-284313b9-7c22-4019-832d-fd4e5f775873 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:20.208201 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-284313b9-7c22-4019-832d-fd4e5f775873 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:20.208734 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-284313b9-7c22-4019-832d-fd4e5f775873 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:20.209510 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-284313b9-7c22-4019-832d-fd4e5f775873 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:20.210226 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-284313b9-7c22-4019-832d-fd4e5f775873 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:20.438393 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-284313b9-7c22-4019-832d-fd4e5f775873 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:20.453550 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-94f2864b-1696-41ea-be32-bf92f90bb7c8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:20.454646 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-94f2864b-1696-41ea-be32-bf92f90bb7c8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:20.461038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-284313b9-7c22-4019-832d-fd4e5f775873 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:20.462899 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-94f2864b-1696-41ea-be32-bf92f90bb7c8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:20.463681 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-284313b9-7c22-4019-832d-fd4e5f775873 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:20.465074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-94f2864b-1696-41ea-be32-bf92f90bb7c8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:20.465572 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-284313b9-7c22-4019-832d-fd4e5f775873 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1721 microversion: 2.20 time: 0.276196 Jul 01 16:42:20.466613 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 129/250] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:20 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1721 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:20.466727 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-94f2864b-1696-41ea-be32-bf92f90bb7c8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:20.467858 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-94f2864b-1696-41ea-be32-bf92f90bb7c8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:20.619807 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-dc2ecff9-9319-4526-ad75-f80cf018f796 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:20.620786 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-dc2ecff9-9319-4526-ad75-f80cf018f796 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:20.623419 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-94f2864b-1696-41ea-be32-bf92f90bb7c8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:20.627884 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dc2ecff9-9319-4526-ad75-f80cf018f796 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:20.628624 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dc2ecff9-9319-4526-ad75-f80cf018f796 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:20.629670 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dc2ecff9-9319-4526-ad75-f80cf018f796 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:20.630274 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dc2ecff9-9319-4526-ad75-f80cf018f796 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:20.635346 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-94f2864b-1696-41ea-be32-bf92f90bb7c8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.186271 Jul 01 16:42:20.635936 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 122/251] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:20 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:20.651461 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0a5f57d2-023e-49c1-88ec-dc2cf061a701 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:20.652109 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0a5f57d2-023e-49c1-88ec-dc2cf061a701 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:20.659182 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0a5f57d2-023e-49c1-88ec-dc2cf061a701 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:20.659633 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0a5f57d2-023e-49c1-88ec-dc2cf061a701 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:20.660601 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0a5f57d2-023e-49c1-88ec-dc2cf061a701 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:20.661336 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0a5f57d2-023e-49c1-88ec-dc2cf061a701 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:20.739311 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0a5f57d2-023e-49c1-88ec-dc2cf061a701 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:20.746954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0a5f57d2-023e-49c1-88ec-dc2cf061a701 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1237 microversion: 2.1 time: 0.099746 Jul 01 16:42:20.747633 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 123/252] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:20 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1237 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:20.803961 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-dc2ecff9-9319-4526-ad75-f80cf018f796 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:20.811467 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-dc2ecff9-9319-4526-ad75-f80cf018f796 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.195590 Jul 01 16:42:20.815449 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 130/253] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:20 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:21.123678 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3ce5afa6-1c70-4efd-b2ed-d752614225aa tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:21.124304 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3ce5afa6-1c70-4efd-b2ed-d752614225aa tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:21.131196 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3ce5afa6-1c70-4efd-b2ed-d752614225aa tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:21.131806 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3ce5afa6-1c70-4efd-b2ed-d752614225aa tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:21.132732 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3ce5afa6-1c70-4efd-b2ed-d752614225aa tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:21.133193 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3ce5afa6-1c70-4efd-b2ed-d752614225aa tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:21.276493 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3ce5afa6-1c70-4efd-b2ed-d752614225aa tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:21.285991 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3ce5afa6-1c70-4efd-b2ed-d752614225aa tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1314 microversion: 2.1 time: 0.165927 Jul 01 16:42:21.287028 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 124/254] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:21 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:21.485386 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-7d7a1bdb-b169-42f6-b914-1543f14d4f6d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:21.486005 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-7d7a1bdb-b169-42f6-b914-1543f14d4f6d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:21.492941 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7d7a1bdb-b169-42f6-b914-1543f14d4f6d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:21.493388 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7d7a1bdb-b169-42f6-b914-1543f14d4f6d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:21.494214 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7d7a1bdb-b169-42f6-b914-1543f14d4f6d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:21.494806 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7d7a1bdb-b169-42f6-b914-1543f14d4f6d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:21.655040 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-35387c0f-c1f9-4f02-b935-52b1f525e9c7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:21.656124 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-35387c0f-c1f9-4f02-b935-52b1f525e9c7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:21.662546 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7d7a1bdb-b169-42f6-b914-1543f14d4f6d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:21.673579 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-35387c0f-c1f9-4f02-b935-52b1f525e9c7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:21.691510 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7d7a1bdb-b169-42f6-b914-1543f14d4f6d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:21.691839 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-35387c0f-c1f9-4f02-b935-52b1f525e9c7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:21.692695 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-35387c0f-c1f9-4f02-b935-52b1f525e9c7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:21.693146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-35387c0f-c1f9-4f02-b935-52b1f525e9c7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:21.693563 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7d7a1bdb-b169-42f6-b914-1543f14d4f6d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:21.695233 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-7d7a1bdb-b169-42f6-b914-1543f14d4f6d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1721 microversion: 2.20 time: 0.213930 Jul 01 16:42:21.697394 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 131/255] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:21 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:21.772568 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c1f929c7-7c59-442c-bf61-e3fe4f3384cc tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:21.776616 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c1f929c7-7c59-442c-bf61-e3fe4f3384cc tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:21.791505 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c1f929c7-7c59-442c-bf61-e3fe4f3384cc tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:21.792487 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c1f929c7-7c59-442c-bf61-e3fe4f3384cc tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:21.793887 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c1f929c7-7c59-442c-bf61-e3fe4f3384cc tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:21.794545 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c1f929c7-7c59-442c-bf61-e3fe4f3384cc tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:21.855033 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-35387c0f-c1f9-4f02-b935-52b1f525e9c7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:21.872741 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-35387c0f-c1f9-4f02-b935-52b1f525e9c7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.223453 Jul 01 16:42:21.873332 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 125/256] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:21 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:21.882654 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8c07e6a5-bc4e-40b9-aed4-a4f0e83996e4 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:21.883527 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8c07e6a5-bc4e-40b9-aed4-a4f0e83996e4 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:21.893951 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8c07e6a5-bc4e-40b9-aed4-a4f0e83996e4 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:21.894713 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8c07e6a5-bc4e-40b9-aed4-a4f0e83996e4 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:21.895881 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8c07e6a5-bc4e-40b9-aed4-a4f0e83996e4 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:21.896324 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8c07e6a5-bc4e-40b9-aed4-a4f0e83996e4 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:21.900332 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c1f929c7-7c59-442c-bf61-e3fe4f3384cc tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:21.925429 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c1f929c7-7c59-442c-bf61-e3fe4f3384cc tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1293 microversion: 2.1 time: 0.150738 Jul 01 16:42:21.927295 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 132/257] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:21 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1293 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:21.961779 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-ef749def-722a-4f8f-99b4-ceb4f9d34d07 req-e6e99f17-a0b3-425e-88b1-24532c045715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74fca065-c0ba-4a16-958e-a991e16bb913", "name": "network-vif-plugged", "status": "completed", "tag": "74960809-e36c-4511-9a63-5f955f9a40f0"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:21.977238 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-ef749def-722a-4f8f-99b4-ceb4f9d34d07 req-e6e99f17-a0b3-425e-88b1-24532c045715 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:21.980376 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-ef749def-722a-4f8f-99b4-ceb4f9d34d07 req-e6e99f17-a0b3-425e-88b1-24532c045715 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:22.020950 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-ef749def-722a-4f8f-99b4-ceb4f9d34d07 req-e6e99f17-a0b3-425e-88b1-24532c045715 service nova] Creating event network-vif-plugged:74960809-e36c-4511-9a63-5f955f9a40f0 for instance 74fca065-c0ba-4a16-958e-a991e16bb913 on hv-cinder-79760 Jul 01 16:42:22.037542 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-ef749def-722a-4f8f-99b4-ceb4f9d34d07 req-e6e99f17-a0b3-425e-88b1-24532c045715 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078864 Jul 01 16:42:22.039473 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 133/258] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:42:22.284445 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8c07e6a5-bc4e-40b9-aed4-a4f0e83996e4 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:22.294524 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8c07e6a5-bc4e-40b9-aed4-a4f0e83996e4 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.416194 Jul 01 16:42:22.295521 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 126/259] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:21 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:22.311396 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d1e330de-d38a-43de-96d8-6b215d06e201 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:22.312246 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d1e330de-d38a-43de-96d8-6b215d06e201 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:22.320096 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:22.322533 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d1e330de-d38a-43de-96d8-6b215d06e201 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:22.323029 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d1e330de-d38a-43de-96d8-6b215d06e201 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:22.323881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d1e330de-d38a-43de-96d8-6b215d06e201 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:22.324536 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d1e330de-d38a-43de-96d8-6b215d06e201 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:22.534661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d1e330de-d38a-43de-96d8-6b215d06e201 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:22.542112 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d1e330de-d38a-43de-96d8-6b215d06e201 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1498 microversion: 2.1 time: 0.237123 Jul 01 16:42:22.542789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 134/260] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:22 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1498 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:22.715502 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-344c4ab9-19a2-47db-988c-674a51f57680 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:22.716277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-344c4ab9-19a2-47db-988c-674a51f57680 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:22.725216 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-344c4ab9-19a2-47db-988c-674a51f57680 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:22.725857 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-344c4ab9-19a2-47db-988c-674a51f57680 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:22.726786 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-344c4ab9-19a2-47db-988c-674a51f57680 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:22.727330 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-344c4ab9-19a2-47db-988c-674a51f57680 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:22.871271 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-344c4ab9-19a2-47db-988c-674a51f57680 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:22.881728 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-344c4ab9-19a2-47db-988c-674a51f57680 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:22.892838 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c918cfa1-91ff-4655-aa69-e7b9ba5e5ca2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:22.893632 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c918cfa1-91ff-4655-aa69-e7b9ba5e5ca2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:22.894394 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-344c4ab9-19a2-47db-988c-674a51f57680 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:22.896187 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-344c4ab9-19a2-47db-988c-674a51f57680 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1721 microversion: 2.20 time: 0.186927 Jul 01 16:42:22.896839 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 127/261] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:22 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:22.910512 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c918cfa1-91ff-4655-aa69-e7b9ba5e5ca2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:22.910984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c918cfa1-91ff-4655-aa69-e7b9ba5e5ca2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:22.911753 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c918cfa1-91ff-4655-aa69-e7b9ba5e5ca2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:22.912183 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c918cfa1-91ff-4655-aa69-e7b9ba5e5ca2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:22.945588 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9e1cac96-d962-4694-afb4-effef20c3b7e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:22.946797 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-9e1cac96-d962-4694-afb4-effef20c3b7e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:22.959403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9e1cac96-d962-4694-afb4-effef20c3b7e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:22.960099 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9e1cac96-d962-4694-afb4-effef20c3b7e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:22.961339 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9e1cac96-d962-4694-afb4-effef20c3b7e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:22.969241 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9e1cac96-d962-4694-afb4-effef20c3b7e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:23.113138 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9e1cac96-d962-4694-afb4-effef20c3b7e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:23.121450 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9e1cac96-d962-4694-afb4-effef20c3b7e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1301 microversion: 2.1 time: 0.181695 Jul 01 16:42:23.122539 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 128/262] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:22 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1301 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:23.257605 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c918cfa1-91ff-4655-aa69-e7b9ba5e5ca2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:23.266806 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c918cfa1-91ff-4655-aa69-e7b9ba5e5ca2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.379033 Jul 01 16:42:23.267384 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 135/263] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:22 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:23.313808 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-72932fc9-1c69-4e1c-a974-1cfd5f7d6641 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:23.314533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-72932fc9-1c69-4e1c-a974-1cfd5f7d6641 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:23.321452 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-72932fc9-1c69-4e1c-a974-1cfd5f7d6641 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:23.321958 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-72932fc9-1c69-4e1c-a974-1cfd5f7d6641 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:23.332660 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-72932fc9-1c69-4e1c-a974-1cfd5f7d6641 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:23.333134 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-72932fc9-1c69-4e1c-a974-1cfd5f7d6641 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:23.379814 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5ff1e568-79d0-47ef-b93f-bebeff15f7d1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:23.380590 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5ff1e568-79d0-47ef-b93f-bebeff15f7d1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:23.391605 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5ff1e568-79d0-47ef-b93f-bebeff15f7d1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:23.392870 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5ff1e568-79d0-47ef-b93f-bebeff15f7d1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:23.393866 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5ff1e568-79d0-47ef-b93f-bebeff15f7d1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:23.394885 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5ff1e568-79d0-47ef-b93f-bebeff15f7d1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:23.429178 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5ff1e568-79d0-47ef-b93f-bebeff15f7d1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 16:42:23.527061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5ff1e568-79d0-47ef-b93f-bebeff15f7d1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "DELETE /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 204 len: 0 microversion: 2.1 time: 0.151837 Jul 01 16:42:23.531829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 136/264] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:42:23 2022] DELETE /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 16:42:23.537866 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c9922230-e078-4000-97c8-12525dd62dc8 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:23.538697 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c9922230-e078-4000-97c8-12525dd62dc8 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:23.539464 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-72932fc9-1c69-4e1c-a974-1cfd5f7d6641 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:23.552945 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c9922230-e078-4000-97c8-12525dd62dc8 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:23.552945 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c9922230-e078-4000-97c8-12525dd62dc8 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:23.552945 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c9922230-e078-4000-97c8-12525dd62dc8 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:23.552945 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c9922230-e078-4000-97c8-12525dd62dc8 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:23.558764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-72932fc9-1c69-4e1c-a974-1cfd5f7d6641 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.249592 Jul 01 16:42:23.559809 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 129/265] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:23 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:23.808694 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c9922230-e078-4000-97c8-12525dd62dc8 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:23.817166 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c9922230-e078-4000-97c8-12525dd62dc8 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1504 microversion: 2.1 time: 0.283965 Jul 01 16:42:23.817828 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 137/266] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:23 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1504 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:23.919061 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c085c5d6-0602-4f32-b4fe-50125eb305d7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:23.919748 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c085c5d6-0602-4f32-b4fe-50125eb305d7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:23.927668 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c085c5d6-0602-4f32-b4fe-50125eb305d7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:23.928226 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c085c5d6-0602-4f32-b4fe-50125eb305d7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:23.929180 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c085c5d6-0602-4f32-b4fe-50125eb305d7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:23.929680 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c085c5d6-0602-4f32-b4fe-50125eb305d7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:24.142161 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c085c5d6-0602-4f32-b4fe-50125eb305d7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:24.146015 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6da8ff7d-5ab4-454f-b3d0-670e3a080c5f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:24.147041 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6da8ff7d-5ab4-454f-b3d0-670e3a080c5f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:24.158608 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6da8ff7d-5ab4-454f-b3d0-670e3a080c5f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:24.159026 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6da8ff7d-5ab4-454f-b3d0-670e3a080c5f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:24.161175 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c085c5d6-0602-4f32-b4fe-50125eb305d7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:24.162925 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c085c5d6-0602-4f32-b4fe-50125eb305d7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:24.164101 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c085c5d6-0602-4f32-b4fe-50125eb305d7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1721 microversion: 2.20 time: 0.249491 Jul 01 16:42:24.176839 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6da8ff7d-5ab4-454f-b3d0-670e3a080c5f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:24.177472 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6da8ff7d-5ab4-454f-b3d0-670e3a080c5f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:24.179801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 130/267] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:23 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:24.263461 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6da8ff7d-5ab4-454f-b3d0-670e3a080c5f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:24.269846 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:24.278406 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6da8ff7d-5ab4-454f-b3d0-670e3a080c5f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1299 microversion: 2.1 time: 0.141886 Jul 01 16:42:24.279577 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 138/268] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:24 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1299 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:24.287774 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1984948e-cddf-4326-b355-e71f08645111 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:24.288618 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1984948e-cddf-4326-b355-e71f08645111 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:24.299633 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1984948e-cddf-4326-b355-e71f08645111 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:24.300230 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1984948e-cddf-4326-b355-e71f08645111 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:24.301112 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1984948e-cddf-4326-b355-e71f08645111 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:24.301549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1984948e-cddf-4326-b355-e71f08645111 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:24.544046 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1984948e-cddf-4326-b355-e71f08645111 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:24.552679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1984948e-cddf-4326-b355-e71f08645111 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.269166 Jul 01 16:42:24.553270 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 131/269] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:24 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:24.577091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-67303c1f-403c-439b-a788-a51088b7021e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:24.577941 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-67303c1f-403c-439b-a788-a51088b7021e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:24.587315 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-67303c1f-403c-439b-a788-a51088b7021e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:24.587759 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-67303c1f-403c-439b-a788-a51088b7021e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:24.588534 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-67303c1f-403c-439b-a788-a51088b7021e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:24.589010 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-67303c1f-403c-439b-a788-a51088b7021e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:24.735613 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-67303c1f-403c-439b-a788-a51088b7021e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:24.743079 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-67303c1f-403c-439b-a788-a51088b7021e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.169964 Jul 01 16:42:24.743654 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 139/270] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:24 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:24.835469 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-05772663-a587-4f90-b904-2a7a73daec5c tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:24.835988 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-05772663-a587-4f90-b904-2a7a73daec5c tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:24.842027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-05772663-a587-4f90-b904-2a7a73daec5c tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:24.842513 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-05772663-a587-4f90-b904-2a7a73daec5c tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:24.844408 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-05772663-a587-4f90-b904-2a7a73daec5c tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:24.844852 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-05772663-a587-4f90-b904-2a7a73daec5c tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:24.981480 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-05772663-a587-4f90-b904-2a7a73daec5c tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:24.989561 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-05772663-a587-4f90-b904-2a7a73daec5c tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1504 microversion: 2.1 time: 0.158258 Jul 01 16:42:24.990126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 132/271] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:24 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:25.183124 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fb611e1e-abb6-4ee6-b265-0c249cd3a70d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:25.183744 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-fb611e1e-abb6-4ee6-b265-0c249cd3a70d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:25.190731 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fb611e1e-abb6-4ee6-b265-0c249cd3a70d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:25.191182 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fb611e1e-abb6-4ee6-b265-0c249cd3a70d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:25.191954 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fb611e1e-abb6-4ee6-b265-0c249cd3a70d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:25.192420 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fb611e1e-abb6-4ee6-b265-0c249cd3a70d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:25.297145 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f230d469-2a69-427a-85e5-ec3f67c4d56b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:25.297926 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f230d469-2a69-427a-85e5-ec3f67c4d56b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:25.304572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f230d469-2a69-427a-85e5-ec3f67c4d56b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:25.305126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f230d469-2a69-427a-85e5-ec3f67c4d56b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:25.306210 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f230d469-2a69-427a-85e5-ec3f67c4d56b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:25.306688 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f230d469-2a69-427a-85e5-ec3f67c4d56b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:25.332702 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fb611e1e-abb6-4ee6-b265-0c249cd3a70d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:25.344577 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fb611e1e-abb6-4ee6-b265-0c249cd3a70d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:25.346363 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fb611e1e-abb6-4ee6-b265-0c249cd3a70d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:25.348625 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fb611e1e-abb6-4ee6-b265-0c249cd3a70d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1721 microversion: 2.20 time: 0.168818 Jul 01 16:42:25.361318 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 140/272] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:25 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:25.444527 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f230d469-2a69-427a-85e5-ec3f67c4d56b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:25.452722 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f230d469-2a69-427a-85e5-ec3f67c4d56b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1366 microversion: 2.1 time: 0.159887 Jul 01 16:42:25.453376 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 133/273] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:25 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:25.570004 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-834d8020-507a-4a66-a608-dcc4cc1ee40a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:25.570632 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-834d8020-507a-4a66-a608-dcc4cc1ee40a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:25.576664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-834d8020-507a-4a66-a608-dcc4cc1ee40a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:25.577114 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-834d8020-507a-4a66-a608-dcc4cc1ee40a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:25.578222 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-834d8020-507a-4a66-a608-dcc4cc1ee40a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:25.578797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-834d8020-507a-4a66-a608-dcc4cc1ee40a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:25.720249 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-834d8020-507a-4a66-a608-dcc4cc1ee40a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:25.727784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-834d8020-507a-4a66-a608-dcc4cc1ee40a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.161615 Jul 01 16:42:25.728352 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 141/274] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:25 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:25.760475 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e7f48274-59bf-4f1a-bd3d-84c2e0dcb051 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:25.761083 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e7f48274-59bf-4f1a-bd3d-84c2e0dcb051 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:25.767337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e7f48274-59bf-4f1a-bd3d-84c2e0dcb051 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:25.767787 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e7f48274-59bf-4f1a-bd3d-84c2e0dcb051 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:25.768554 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e7f48274-59bf-4f1a-bd3d-84c2e0dcb051 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:25.768991 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e7f48274-59bf-4f1a-bd3d-84c2e0dcb051 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:25.904956 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e7f48274-59bf-4f1a-bd3d-84c2e0dcb051 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:25.912969 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e7f48274-59bf-4f1a-bd3d-84c2e0dcb051 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.156307 Jul 01 16:42:25.913526 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 134/275] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:25 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:26.006898 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4ac90aab-dbc7-45e2-9ad8-36f7991f6bbd tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:26.007518 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4ac90aab-dbc7-45e2-9ad8-36f7991f6bbd tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:26.014060 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4ac90aab-dbc7-45e2-9ad8-36f7991f6bbd tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:26.014605 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4ac90aab-dbc7-45e2-9ad8-36f7991f6bbd tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:26.015642 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4ac90aab-dbc7-45e2-9ad8-36f7991f6bbd tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:26.016163 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4ac90aab-dbc7-45e2-9ad8-36f7991f6bbd tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:26.148747 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4ac90aab-dbc7-45e2-9ad8-36f7991f6bbd tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:26.156874 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4ac90aab-dbc7-45e2-9ad8-36f7991f6bbd tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1504 microversion: 2.1 time: 0.154115 Jul 01 16:42:26.157446 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 142/276] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:26 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:26.368728 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6519cf69-461d-4977-9872-a3d642103845 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:26.369315 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6519cf69-461d-4977-9872-a3d642103845 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:26.378398 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6519cf69-461d-4977-9872-a3d642103845 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:26.378862 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6519cf69-461d-4977-9872-a3d642103845 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:26.379807 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6519cf69-461d-4977-9872-a3d642103845 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:26.380237 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6519cf69-461d-4977-9872-a3d642103845 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:26.469851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8191d16d-9ca5-4a83-9f04-e8f9fba4f45a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:26.470529 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8191d16d-9ca5-4a83-9f04-e8f9fba4f45a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:26.476653 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8191d16d-9ca5-4a83-9f04-e8f9fba4f45a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:26.477107 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8191d16d-9ca5-4a83-9f04-e8f9fba4f45a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:26.477884 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8191d16d-9ca5-4a83-9f04-e8f9fba4f45a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:26.478323 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8191d16d-9ca5-4a83-9f04-e8f9fba4f45a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:26.526081 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6519cf69-461d-4977-9872-a3d642103845 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:26.534651 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6519cf69-461d-4977-9872-a3d642103845 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:26.536246 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6519cf69-461d-4977-9872-a3d642103845 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:26.537502 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6519cf69-461d-4977-9872-a3d642103845 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1721 microversion: 2.20 time: 0.172820 Jul 01 16:42:26.538142 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 135/277] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:26 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:26.609617 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8191d16d-9ca5-4a83-9f04-e8f9fba4f45a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:26.617257 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8191d16d-9ca5-4a83-9f04-e8f9fba4f45a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1366 microversion: 2.1 time: 0.151983 Jul 01 16:42:26.617769 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 143/278] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:26 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:26.744928 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-71c0424d-50fb-4ee9-afc7-8a0e4623f96d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:26.745528 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-71c0424d-50fb-4ee9-afc7-8a0e4623f96d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:26.752372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-71c0424d-50fb-4ee9-afc7-8a0e4623f96d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:26.752815 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-71c0424d-50fb-4ee9-afc7-8a0e4623f96d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:26.753573 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-71c0424d-50fb-4ee9-afc7-8a0e4623f96d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:26.754006 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-71c0424d-50fb-4ee9-afc7-8a0e4623f96d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:26.903307 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-71c0424d-50fb-4ee9-afc7-8a0e4623f96d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:26.911154 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-71c0424d-50fb-4ee9-afc7-8a0e4623f96d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.170078 Jul 01 16:42:26.911721 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 136/279] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:26 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:26.930409 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-00acc532-8cfb-42dc-ae96-16224e1287b9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:26.931028 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-00acc532-8cfb-42dc-ae96-16224e1287b9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:26.937950 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-00acc532-8cfb-42dc-ae96-16224e1287b9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:26.938417 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-00acc532-8cfb-42dc-ae96-16224e1287b9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:26.939457 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-00acc532-8cfb-42dc-ae96-16224e1287b9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:26.939879 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-00acc532-8cfb-42dc-ae96-16224e1287b9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:27.075353 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-00acc532-8cfb-42dc-ae96-16224e1287b9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:27.083610 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-00acc532-8cfb-42dc-ae96-16224e1287b9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1358 microversion: 2.1 time: 0.157373 Jul 01 16:42:27.084173 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 144/280] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:26 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:27.174135 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2bbd08ac-c2ad-4dc5-85a0-2eac76b8dc2f tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:27.174673 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2bbd08ac-c2ad-4dc5-85a0-2eac76b8dc2f tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:27.180750 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2bbd08ac-c2ad-4dc5-85a0-2eac76b8dc2f tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:27.181324 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2bbd08ac-c2ad-4dc5-85a0-2eac76b8dc2f tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:27.182134 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2bbd08ac-c2ad-4dc5-85a0-2eac76b8dc2f tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:27.182635 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2bbd08ac-c2ad-4dc5-85a0-2eac76b8dc2f tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:27.320014 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2bbd08ac-c2ad-4dc5-85a0-2eac76b8dc2f tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:27.323223 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=100 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:27.331318 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2bbd08ac-c2ad-4dc5-85a0-2eac76b8dc2f tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1504 microversion: 2.1 time: 0.161244 Jul 01 16:42:27.333433 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 137/281] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:27 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:27.556426 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b9901da5-98ad-47fe-939b-deabd4867cba tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:27.557039 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b9901da5-98ad-47fe-939b-deabd4867cba tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:27.564261 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b9901da5-98ad-47fe-939b-deabd4867cba tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:27.564710 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b9901da5-98ad-47fe-939b-deabd4867cba tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:27.565503 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b9901da5-98ad-47fe-939b-deabd4867cba tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:27.565937 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b9901da5-98ad-47fe-939b-deabd4867cba tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:27.635417 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f42f881a-ef3f-41bc-9373-294e5f63119a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:27.636049 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f42f881a-ef3f-41bc-9373-294e5f63119a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:27.643214 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f42f881a-ef3f-41bc-9373-294e5f63119a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:27.643663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f42f881a-ef3f-41bc-9373-294e5f63119a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:27.644427 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f42f881a-ef3f-41bc-9373-294e5f63119a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:27.644858 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f42f881a-ef3f-41bc-9373-294e5f63119a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:27.856801 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b9901da5-98ad-47fe-939b-deabd4867cba tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:27.868761 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b9901da5-98ad-47fe-939b-deabd4867cba tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:27.870754 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b9901da5-98ad-47fe-939b-deabd4867cba tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:27.872320 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b9901da5-98ad-47fe-939b-deabd4867cba tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1721 microversion: 2.20 time: 0.319704 Jul 01 16:42:27.873522 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 145/282] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:27 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1721 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:27.928928 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5cf0d670-0c08-4df4-8631-1f3ab6c14be9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:27.929675 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5cf0d670-0c08-4df4-8631-1f3ab6c14be9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:27.936053 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5cf0d670-0c08-4df4-8631-1f3ab6c14be9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:27.936856 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5cf0d670-0c08-4df4-8631-1f3ab6c14be9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:27.937890 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5cf0d670-0c08-4df4-8631-1f3ab6c14be9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:27.938948 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5cf0d670-0c08-4df4-8631-1f3ab6c14be9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:27.954206 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f42f881a-ef3f-41bc-9373-294e5f63119a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:27.962815 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f42f881a-ef3f-41bc-9373-294e5f63119a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1366 microversion: 2.1 time: 0.332067 Jul 01 16:42:27.964209 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 138/283] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:27 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:28.106309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c38e10a5-4bc4-42c5-9353-abd77a2ad5e7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:28.111561 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c38e10a5-4bc4-42c5-9353-abd77a2ad5e7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:28.136054 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c38e10a5-4bc4-42c5-9353-abd77a2ad5e7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:28.136507 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c38e10a5-4bc4-42c5-9353-abd77a2ad5e7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:28.137291 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c38e10a5-4bc4-42c5-9353-abd77a2ad5e7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:28.137924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c38e10a5-4bc4-42c5-9353-abd77a2ad5e7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:28.182729 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5cf0d670-0c08-4df4-8631-1f3ab6c14be9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:28.194378 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5cf0d670-0c08-4df4-8631-1f3ab6c14be9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.269594 Jul 01 16:42:28.195299 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 146/284] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:27 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:28.352107 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b11a3159-b103-4b47-ac3d-b4b9f77e3c5d tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:28.352861 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b11a3159-b103-4b47-ac3d-b4b9f77e3c5d tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:28.362230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b11a3159-b103-4b47-ac3d-b4b9f77e3c5d tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:28.363007 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b11a3159-b103-4b47-ac3d-b4b9f77e3c5d tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:28.364617 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b11a3159-b103-4b47-ac3d-b4b9f77e3c5d tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:28.365110 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b11a3159-b103-4b47-ac3d-b4b9f77e3c5d tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:28.495665 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c38e10a5-4bc4-42c5-9353-abd77a2ad5e7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:28.510776 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c38e10a5-4bc4-42c5-9353-abd77a2ad5e7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1548 microversion: 2.1 time: 0.408575 Jul 01 16:42:28.526456 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 139/285] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:28 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1548 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:28.534510 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-156114dd-0462-4278-93e2-8c80e317eded tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:28.535542 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-156114dd-0462-4278-93e2-8c80e317eded tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:28.543135 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-156114dd-0462-4278-93e2-8c80e317eded tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:28.543583 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-156114dd-0462-4278-93e2-8c80e317eded tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:28.544385 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-156114dd-0462-4278-93e2-8c80e317eded tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:28.544820 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-156114dd-0462-4278-93e2-8c80e317eded tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:28.700341 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b11a3159-b103-4b47-ac3d-b4b9f77e3c5d tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:28.709409 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b11a3159-b103-4b47-ac3d-b4b9f77e3c5d tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1504 microversion: 2.1 time: 0.362017 Jul 01 16:42:28.712680 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 147/286] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:28 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1504 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:28.790504 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-156114dd-0462-4278-93e2-8c80e317eded tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:28.804147 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-156114dd-0462-4278-93e2-8c80e317eded tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1548 microversion: 2.1 time: 0.276409 Jul 01 16:42:28.805601 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 140/287] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:28 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1548 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:28.823614 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cb77cdc4-bc10-4352-aefa-371bc5eca40c tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:28.827897 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-cb77cdc4-bc10-4352-aefa-371bc5eca40c tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:28.829340 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-cb77cdc4-bc10-4352-aefa-371bc5eca40c tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Searching by: {'deleted': False, 'project_id': 'ef0cc672766c47759a088a398d95147f'} {{(pid=124316) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 16:42:28.861140 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cb77cdc4-bc10-4352-aefa-371bc5eca40c tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:28.862155 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cb77cdc4-bc10-4352-aefa-371bc5eca40c tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:28.863456 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cb77cdc4-bc10-4352-aefa-371bc5eca40c tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:28.864288 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cb77cdc4-bc10-4352-aefa-371bc5eca40c tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:28.896262 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-8694fe80-e5e7-44cd-920f-c1b27feaf3a0 req-4da976f6-b0cb-47aa-8f52-cdec1f115d6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d475a49d-1ee9-4cb0-aaea-507155a02204", "tag": "b942fa2d-b73f-482d-a3fc-1e5162c3f4a5"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:28.901660 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=98 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:28.923581 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-8694fe80-e5e7-44cd-920f-c1b27feaf3a0 req-4da976f6-b0cb-47aa-8f52-cdec1f115d6c service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:28.924288 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-8694fe80-e5e7-44cd-920f-c1b27feaf3a0 req-4da976f6-b0cb-47aa-8f52-cdec1f115d6c service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:28.944653 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-8694fe80-e5e7-44cd-920f-c1b27feaf3a0 req-4da976f6-b0cb-47aa-8f52-cdec1f115d6c service nova] Creating event network-changed:b942fa2d-b73f-482d-a3fc-1e5162c3f4a5 for instance d475a49d-1ee9-4cb0-aaea-507155a02204 on hv-cinder-79760 Jul 01 16:42:28.957484 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-8694fe80-e5e7-44cd-920f-c1b27feaf3a0 req-4da976f6-b0cb-47aa-8f52-cdec1f115d6c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070118 Jul 01 16:42:28.958779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 141/288] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:42:28.966783 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f4d825ad-ff81-4c41-8413-6599eb28aafc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:28.968701 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f4d825ad-ff81-4c41-8413-6599eb28aafc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:28.991517 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f4d825ad-ff81-4c41-8413-6599eb28aafc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:28.992799 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f4d825ad-ff81-4c41-8413-6599eb28aafc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:28.993945 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f4d825ad-ff81-4c41-8413-6599eb28aafc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:28.996860 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f4d825ad-ff81-4c41-8413-6599eb28aafc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:29.096613 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.multi_cell_list [None req-cb77cdc4-bc10-4352-aefa-371bc5eca40c tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124316) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 16:42:29.249193 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-cb77cdc4-bc10-4352-aefa-371bc5eca40c tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.430020 Jul 01 16:42:29.250148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 148/289] 10.222.0.57 () {58 vars in 1124 bytes} [Fri Jul 1 16:42:28 2022] GET /compute/v2.1/servers => generated 342 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:42:29.255726 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-7c322be4-78a7-495b-a70e-3906364edf07 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:29.256976 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-7c322be4-78a7-495b-a70e-3906364edf07 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:29.263022 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7c322be4-78a7-495b-a70e-3906364edf07 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:29.263480 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7c322be4-78a7-495b-a70e-3906364edf07 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:29.264266 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7c322be4-78a7-495b-a70e-3906364edf07 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:29.265658 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7c322be4-78a7-495b-a70e-3906364edf07 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:29.296253 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f4d825ad-ff81-4c41-8413-6599eb28aafc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:29.324132 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f4d825ad-ff81-4c41-8413-6599eb28aafc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:29.325972 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f4d825ad-ff81-4c41-8413-6599eb28aafc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:29.331152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f4d825ad-ff81-4c41-8413-6599eb28aafc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1742 microversion: 2.20 time: 0.370397 Jul 01 16:42:29.331793 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 142/290] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:28 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1742 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:29.345077 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-87f7fcca-c84e-4d12-b295-13eb549219d6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:29.345688 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-87f7fcca-c84e-4d12-b295-13eb549219d6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:29.352684 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-87f7fcca-c84e-4d12-b295-13eb549219d6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:29.353510 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-87f7fcca-c84e-4d12-b295-13eb549219d6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:29.354521 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-87f7fcca-c84e-4d12-b295-13eb549219d6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:29.355146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-87f7fcca-c84e-4d12-b295-13eb549219d6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:29.480619 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7c322be4-78a7-495b-a70e-3906364edf07 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:29.490495 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-7c322be4-78a7-495b-a70e-3906364edf07 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1366 microversion: 2.1 time: 0.239075 Jul 01 16:42:29.491869 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 149/291] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:29 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:29.497923 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-185e0195-a33c-4b1d-a92d-990564d2284b tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:29.498873 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-185e0195-a33c-4b1d-a92d-990564d2284b tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:29.507754 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-185e0195-a33c-4b1d-a92d-990564d2284b tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:29.508561 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-185e0195-a33c-4b1d-a92d-990564d2284b tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:29.509719 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-185e0195-a33c-4b1d-a92d-990564d2284b tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:29.511373 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-185e0195-a33c-4b1d-a92d-990564d2284b tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:29.585478 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-87f7fcca-c84e-4d12-b295-13eb549219d6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:29.600112 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-87f7fcca-c84e-4d12-b295-13eb549219d6 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.267060 Jul 01 16:42:29.602466 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 143/292] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:29 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:29.627013 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=12 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:29.713198 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-185e0195-a33c-4b1d-a92d-990564d2284b tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:29.718099 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-3db19d15-b159-48cb-8052-efebf00f8497 req-7e88dc6c-1316-4628-a3ad-5c578069cb5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c56d1d-53f0-469d-8f06-f34ae6c6cf40", "name": "network-vif-deleted", "tag": "ea5701c7-2fd8-4a27-843f-6febced6bafb"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:29.727096 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-3db19d15-b159-48cb-8052-efebf00f8497 req-7e88dc6c-1316-4628-a3ad-5c578069cb5e service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:29.727535 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-3db19d15-b159-48cb-8052-efebf00f8497 req-7e88dc6c-1316-4628-a3ad-5c578069cb5e service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:29.729186 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-185e0195-a33c-4b1d-a92d-990564d2284b tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1548 microversion: 2.1 time: 0.235861 Jul 01 16:42:29.729959 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 150/293] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:29 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1548 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:29.734474 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-7c6a6785-a6cf-4038-a2cb-e5216b498205 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:29.735259 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-7c6a6785-a6cf-4038-a2cb-e5216b498205 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:29.739419 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-3db19d15-b159-48cb-8052-efebf00f8497 req-7e88dc6c-1316-4628-a3ad-5c578069cb5e service nova] Creating event network-vif-deleted:ea5701c7-2fd8-4a27-843f-6febced6bafb for instance 86c56d1d-53f0-469d-8f06-f34ae6c6cf40 on hv-cinder-79760 Jul 01 16:42:29.741326 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7c6a6785-a6cf-4038-a2cb-e5216b498205 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:29.741772 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7c6a6785-a6cf-4038-a2cb-e5216b498205 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:29.742771 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7c6a6785-a6cf-4038-a2cb-e5216b498205 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:29.743209 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7c6a6785-a6cf-4038-a2cb-e5216b498205 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:29.745143 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-3db19d15-b159-48cb-8052-efebf00f8497 req-7e88dc6c-1316-4628-a3ad-5c578069cb5e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038069 Jul 01 16:42:29.746135 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 144/294] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:42:29.807578 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7c6a6785-a6cf-4038-a2cb-e5216b498205 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:29.815881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-7c6a6785-a6cf-4038-a2cb-e5216b498205 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1462 microversion: 2.1 time: 0.084932 Jul 01 16:42:29.816452 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 151/295] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:29 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:30.352819 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-becf50bc-8c9d-4fc4-b49b-7e607e259bd8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:30.353552 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-becf50bc-8c9d-4fc4-b49b-7e607e259bd8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:30.360831 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-becf50bc-8c9d-4fc4-b49b-7e607e259bd8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:30.361282 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-becf50bc-8c9d-4fc4-b49b-7e607e259bd8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:30.362043 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-becf50bc-8c9d-4fc4-b49b-7e607e259bd8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:30.362511 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-becf50bc-8c9d-4fc4-b49b-7e607e259bd8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:30.497024 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-becf50bc-8c9d-4fc4-b49b-7e607e259bd8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:30.506171 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-becf50bc-8c9d-4fc4-b49b-7e607e259bd8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:30.507788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-becf50bc-8c9d-4fc4-b49b-7e607e259bd8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:30.508250 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-bc0074e8-b745-4fab-b5f6-ae1863f9d520 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:30.508932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-becf50bc-8c9d-4fc4-b49b-7e607e259bd8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1742 microversion: 2.20 time: 0.160703 Jul 01 16:42:30.509045 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-bc0074e8-b745-4fab-b5f6-ae1863f9d520 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:30.509480 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 145/296] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:30 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:30.515881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bc0074e8-b745-4fab-b5f6-ae1863f9d520 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:30.516054 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bc0074e8-b745-4fab-b5f6-ae1863f9d520 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:30.516771 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bc0074e8-b745-4fab-b5f6-ae1863f9d520 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:30.517209 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bc0074e8-b745-4fab-b5f6-ae1863f9d520 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:30.619583 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9be8ed79-ba97-4fe6-875b-8329c12ce995 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:30.620354 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-9be8ed79-ba97-4fe6-875b-8329c12ce995 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:30.634060 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9be8ed79-ba97-4fe6-875b-8329c12ce995 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:30.634542 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9be8ed79-ba97-4fe6-875b-8329c12ce995 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:30.635327 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9be8ed79-ba97-4fe6-875b-8329c12ce995 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:30.635768 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9be8ed79-ba97-4fe6-875b-8329c12ce995 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:30.666591 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-bc0074e8-b745-4fab-b5f6-ae1863f9d520 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:30.711339 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-bc0074e8-b745-4fab-b5f6-ae1863f9d520 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1366 microversion: 2.1 time: 0.205135 Jul 01 16:42:30.711944 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 152/297] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:30 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:30.850289 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-12721941-fadc-41e8-b6d4-9609179bb0bb tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:30.853823 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-12721941-fadc-41e8-b6d4-9609179bb0bb tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:30.871476 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-12721941-fadc-41e8-b6d4-9609179bb0bb tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:30.875961 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-12721941-fadc-41e8-b6d4-9609179bb0bb tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:30.879343 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-12721941-fadc-41e8-b6d4-9609179bb0bb tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:30.879784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-12721941-fadc-41e8-b6d4-9609179bb0bb tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:30.944032 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9be8ed79-ba97-4fe6-875b-8329c12ce995 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:30.951424 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-12721941-fadc-41e8-b6d4-9609179bb0bb tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:30.952651 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-12721941-fadc-41e8-b6d4-9609179bb0bb tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:30.953313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-12721941-fadc-41e8-b6d4-9609179bb0bb tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lazy-loading 'fault' on Instance uuid 86c56d1d-53f0-469d-8f06-f34ae6c6cf40 {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:42:30.954124 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9be8ed79-ba97-4fe6-875b-8329c12ce995 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.339254 Jul 01 16:42:30.964522 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 146/298] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:30 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:31.031697 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-0b30ecd5-aa8b-4d87-9d0d-20388b0cef48 req-3e257929-c9f8-4a60-8309-a57d0e8fc577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8498c0a8-d20e-4261-a0a1-d4c33004141c", "name": "network-vif-plugged", "status": "completed", "tag": "2c1b8fc6-0b53-4c5c-83ee-2d68d226acfa"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:31.043103 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-0b30ecd5-aa8b-4d87-9d0d-20388b0cef48 req-3e257929-c9f8-4a60-8309-a57d0e8fc577 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:31.044214 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-0b30ecd5-aa8b-4d87-9d0d-20388b0cef48 req-3e257929-c9f8-4a60-8309-a57d0e8fc577 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:31.066272 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-0b30ecd5-aa8b-4d87-9d0d-20388b0cef48 req-3e257929-c9f8-4a60-8309-a57d0e8fc577 service nova] Creating event network-vif-plugged:2c1b8fc6-0b53-4c5c-83ee-2d68d226acfa for instance 8498c0a8-d20e-4261-a0a1-d4c33004141c on hv-cinder-79760 Jul 01 16:42:31.084122 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-0b30ecd5-aa8b-4d87-9d0d-20388b0cef48 req-3e257929-c9f8-4a60-8309-a57d0e8fc577 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055927 Jul 01 16:42:31.085000 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 147/299] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:42:31.292440 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-393a2737-4a83-4534-84c4-166bdaa68196 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f820122-863d-4db8-81b7-77c3be6c8111"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:31.293590 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-393a2737-4a83-4534-84c4-166bdaa68196 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:31.300972 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-393a2737-4a83-4534-84c4-166bdaa68196 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:31.301396 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-393a2737-4a83-4534-84c4-166bdaa68196 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:31.302174 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-393a2737-4a83-4534-84c4-166bdaa68196 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:31.302633 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-393a2737-4a83-4534-84c4-166bdaa68196 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:31.325663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-12721941-fadc-41e8-b6d4-9609179bb0bb tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:31.348068 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-12721941-fadc-41e8-b6d4-9609179bb0bb tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 200 len: 1304 microversion: 2.1 time: 0.517781 Jul 01 16:42:31.363753 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 153/300] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:30 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 1304 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:31.528356 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0cde5d16-868a-4982-8d19-6534e0d26cea tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:31.528994 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0cde5d16-868a-4982-8d19-6534e0d26cea tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:31.535968 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0cde5d16-868a-4982-8d19-6534e0d26cea tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:31.536450 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0cde5d16-868a-4982-8d19-6534e0d26cea tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:31.537392 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0cde5d16-868a-4982-8d19-6534e0d26cea tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:31.537910 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0cde5d16-868a-4982-8d19-6534e0d26cea tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:31.683482 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0cde5d16-868a-4982-8d19-6534e0d26cea tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:31.687048 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=100 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:31.692608 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0cde5d16-868a-4982-8d19-6534e0d26cea tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:31.694121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0cde5d16-868a-4982-8d19-6534e0d26cea tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:31.695440 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0cde5d16-868a-4982-8d19-6534e0d26cea tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1742 microversion: 2.20 time: 0.171304 Jul 01 16:42:31.696071 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 154/301] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:31 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1742 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:31.730709 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-53405bb8-81d2-41ed-bdcb-79bf7b3ea3f0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:31.731425 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-53405bb8-81d2-41ed-bdcb-79bf7b3ea3f0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:31.737771 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-53405bb8-81d2-41ed-bdcb-79bf7b3ea3f0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:31.738227 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-53405bb8-81d2-41ed-bdcb-79bf7b3ea3f0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:31.739025 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-53405bb8-81d2-41ed-bdcb-79bf7b3ea3f0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:31.739464 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-53405bb8-81d2-41ed-bdcb-79bf7b3ea3f0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:31.894073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-53405bb8-81d2-41ed-bdcb-79bf7b3ea3f0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:31.902011 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-53405bb8-81d2-41ed-bdcb-79bf7b3ea3f0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1366 microversion: 2.1 time: 0.176568 Jul 01 16:42:31.902628 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 155/302] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:31 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:31.972046 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8dc5784a-b430-46e8-b004-e1936947efb9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:31.972710 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8dc5784a-b430-46e8-b004-e1936947efb9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:31.978668 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8dc5784a-b430-46e8-b004-e1936947efb9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:31.979109 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8dc5784a-b430-46e8-b004-e1936947efb9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:31.979914 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8dc5784a-b430-46e8-b004-e1936947efb9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:31.980339 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8dc5784a-b430-46e8-b004-e1936947efb9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:32.117348 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8dc5784a-b430-46e8-b004-e1936947efb9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:32.125926 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8dc5784a-b430-46e8-b004-e1936947efb9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.157253 Jul 01 16:42:32.129044 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 156/303] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:31 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:32.370846 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-13fb0eb5-154c-4df6-b409-db20b8fe36b1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:32.371468 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-13fb0eb5-154c-4df6-b409-db20b8fe36b1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: 86c56d1d-53f0-469d-8f06-f34ae6c6cf40] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:32.379409 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13fb0eb5-154c-4df6-b409-db20b8fe36b1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:32.379859 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13fb0eb5-154c-4df6-b409-db20b8fe36b1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:32.380634 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13fb0eb5-154c-4df6-b409-db20b8fe36b1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:32.381066 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13fb0eb5-154c-4df6-b409-db20b8fe36b1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:32.395314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-13fb0eb5-154c-4df6-b409-db20b8fe36b1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] HTTP exception thrown: Instance 86c56d1d-53f0-469d-8f06-f34ae6c6cf40 could not be found. Jul 01 16:42:32.397153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-13fb0eb5-154c-4df6-b409-db20b8fe36b1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Request method failure captured: Jul 01 16:42:32.397153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 HTTP/1.1 Jul 01 16:42:32.397153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:42:32.397153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:42:32.397153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:42:32.397153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:42:32.397153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:42:32.397153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:42:32.397153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:42:32.397153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:42:32.397153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyPQNdtPzVBLscLHA3Cbc8jl5kGivzsVS6leoyfYS29exsafoYLvQTkHjx-qEQQtHVv1u_aKwM8x0ooUZ_iC_U-PSGj1V5efwIAvqrnULz1qM3YkNM4lWkwub5NfVs2dX_kV272IVVSFygigNQ6FTA0r3Ru0DiOCZXt5SmRSbE6hkL0 Jul 01 16:42:32.397153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:42:32.397153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:42:32.397153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:42:32.397153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:42:32.397153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:42:32.397153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:42:32.397153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: b6598cf49d3a4426be411fa45be0c7c8 Jul 01 16:42:32.397153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-VolumesActionsTest-1818344444 Jul 01 16:42:32.397153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:42:32.397153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:42:32.398514 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b6598cf49d3a4426be411fa45be0c7c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b6598cf49d3a4426be411fa45be0c7c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b6598cf49d3a4426be411fa45be0c7c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b6598cf49d3a4426be411fa45be0c7c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:42:32.398514 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-VolumesActionsTest-1818344444 Jul 01 16:42:32.398514 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: b6598cf49d3a4426be411fa45be0c7c8 Jul 01 16:42:32.398514 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-VolumesActionsTest-1818344444 Jul 01 16:42:32.398514 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-VolumesActionsTest-1818344444-project Jul 01 16:42:32.398514 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:42:32.398514 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:42:32.398514 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: 1f2a1540974a444f8341d395d6a2b070 Jul 01 16:42:32.398514 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-VolumesActionsTest-1818344444-project Jul 01 16:42:32.398514 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: > Jul 01 16:42:32.398514 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Instance 86c56d1d-53f0-469d-8f06-f34ae6c6cf40 could not be found. Jul 01 16:42:32.398514 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'id': '86c56d1d-53f0-469d-8f06-f34ae6c6cf40'} Jul 01 16:42:32.399242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:42:32.399242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:42:32.399242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:42:32.399242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:42:32.399242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:42:32.399242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:42:32.399242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:42:32.399242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:42:32.399242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:42:32.399242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:42:32.399242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86c56d1d-53f0-469d-8f06-f34ae6c6cf40 could not be found. Jul 01 16:42:32.399242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:42:32.399242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:42:32.399242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:42:32.399242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:42:32.399242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:42:32.399242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:42:32.399242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:42:32.399242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:42:32.399242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:42:32.400461 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:42:32.400461 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:42:32.400461 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:42:32.400461 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:42:32.400461 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:42:32.400461 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:42:32.400461 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:42:32.400461 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86c56d1d-53f0-469d-8f06-f34ae6c6cf40 could not be found. Jul 01 16:42:32.400461 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:42:32.400461 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:42:32.400461 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:42:32.400461 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:42:32.400461 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:42:32.400461 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:42:32.400461 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:42:32.400461 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:42:32.400461 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86c56d1d-53f0-469d-8f06-f34ae6c6cf40 could not be found. Jul 01 16:42:32.400461 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:42:32.402374 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-13fb0eb5-154c-4df6-b409-db20b8fe36b1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Returning 404 to user: Instance 86c56d1d-53f0-469d-8f06-f34ae6c6cf40 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:42:32.402374 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-13fb0eb5-154c-4df6-b409-db20b8fe36b1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40" status: 404 len: 111 microversion: 2.1 time: 0.032165 Jul 01 16:42:32.402374 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 157/304] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:32 2022] GET /compute/v2.1/servers/86c56d1d-53f0-469d-8f06-f34ae6c6cf40 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 16:42:32.516195 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-996bbf1b-208d-45ab-b60e-101396f42159 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-841564124", "imageRef": "42a4b1a9-dea6-4c87-a2c1-328b9c0c8558", "flavorRef": "452", "networks": [{"uuid": "75014e88-f269-4136-926c-e34ab9a26542"}]}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:32.578697 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-996bbf1b-208d-45ab-b60e-101396f42159 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] validate_networks() for [('75014e88-f269-4136-926c-e34ab9a26542', None, None, None, None, None)] {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 16:42:33.194241 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-996bbf1b-208d-45ab-b60e-101396f42159 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 16:42:33.195215 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-996bbf1b-208d-45ab-b60e-101396f42159 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 16:42:33.195870 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-996bbf1b-208d-45ab-b60e-101396f42159 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 16:42:33.196321 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-996bbf1b-208d-45ab-b60e-101396f42159 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 16:42:33.205628 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-996bbf1b-208d-45ab-b60e-101396f42159 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 16:42:33.241185 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-996bbf1b-208d-45ab-b60e-101396f42159 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:33.251699 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-996bbf1b-208d-45ab-b60e-101396f42159 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:33.271717 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-996bbf1b-208d-45ab-b60e-101396f42159 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:33.272718 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-996bbf1b-208d-45ab-b60e-101396f42159 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:33.331592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-996bbf1b-208d-45ab-b60e-101396f42159 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Getting quotas for project b6598cf49d3a4426be411fa45be0c7c8. Resources: {'ram', 'cores', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:42:33.342225 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-996bbf1b-208d-45ab-b60e-101396f42159 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Getting quotas for user 1f2a1540974a444f8341d395d6a2b070 and project b6598cf49d3a4426be411fa45be0c7c8. Resources: {'ram', 'cores', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:42:33.370371 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-996bbf1b-208d-45ab-b60e-101396f42159 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 16:42:33.373048 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-996bbf1b-208d-45ab-b60e-101396f42159 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42a4b1a9-dea6-4c87-a2c1-328b9c0c8558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 16:42:33.420565 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-393a2737-4a83-4534-84c4-166bdaa68196 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "POST /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.132264 Jul 01 16:42:33.423775 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 148/305] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 1 16:42:31 2022] POST /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913/os-volume_attachments => generated 194 bytes in 2136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:42:33.438028 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d0ce88da-aad6-4721-ad82-1a38eee14230 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:33.439278 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d0ce88da-aad6-4721-ad82-1a38eee14230 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:33.442338 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-996bbf1b-208d-45ab-b60e-101396f42159 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.930441 Jul 01 16:42:33.444882 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 158/306] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 1 16:42:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 16:42:33.451625 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a46f7e5b-221d-4ba1-8df7-a6994ce47cdd tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:33.456904 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a46f7e5b-221d-4ba1-8df7-a6994ce47cdd tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:33.464464 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a46f7e5b-221d-4ba1-8df7-a6994ce47cdd tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:33.465194 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a46f7e5b-221d-4ba1-8df7-a6994ce47cdd tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:33.466268 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a46f7e5b-221d-4ba1-8df7-a6994ce47cdd tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:33.467872 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a46f7e5b-221d-4ba1-8df7-a6994ce47cdd tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:33.483692 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d0ce88da-aad6-4721-ad82-1a38eee14230 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:33.484089 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d0ce88da-aad6-4721-ad82-1a38eee14230 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:33.484807 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d0ce88da-aad6-4721-ad82-1a38eee14230 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:33.485252 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d0ce88da-aad6-4721-ad82-1a38eee14230 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:33.775778 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a46f7e5b-221d-4ba1-8df7-a6994ce47cdd tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:33.785121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a46f7e5b-221d-4ba1-8df7-a6994ce47cdd tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1366 microversion: 2.1 time: 0.337895 Jul 01 16:42:33.794280 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d0ce88da-aad6-4721-ad82-1a38eee14230 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:33.795295 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 159/307] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:33 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1366 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:33.800489 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d0ce88da-aad6-4721-ad82-1a38eee14230 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:33.801506 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-49e3bdfb-df3c-44bb-9029-5f4ade0751ee tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:33.802746 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-49e3bdfb-df3c-44bb-9029-5f4ade0751ee tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:33.803349 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d0ce88da-aad6-4721-ad82-1a38eee14230 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:33.804327 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d0ce88da-aad6-4721-ad82-1a38eee14230 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1737 microversion: 2.20 time: 0.377172 Jul 01 16:42:33.806080 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 149/308] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:33 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1737 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:33.814023 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-58631816-238d-4115-a297-df95409950da tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:33.815740 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-58631816-238d-4115-a297-df95409950da tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:33.826184 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-49e3bdfb-df3c-44bb-9029-5f4ade0751ee tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:33.826834 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-49e3bdfb-df3c-44bb-9029-5f4ade0751ee tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:33.829920 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-49e3bdfb-df3c-44bb-9029-5f4ade0751ee tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:33.830523 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-49e3bdfb-df3c-44bb-9029-5f4ade0751ee tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:33.905406 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-58631816-238d-4115-a297-df95409950da tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:33.914008 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-58631816-238d-4115-a297-df95409950da tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1213 microversion: 2.1 time: 0.105942 Jul 01 16:42:33.915054 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 150/309] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:33 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1213 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:34.033380 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-49e3bdfb-df3c-44bb-9029-5f4ade0751ee tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:34.044631 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-49e3bdfb-df3c-44bb-9029-5f4ade0751ee tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1503 microversion: 2.1 time: 0.247470 Jul 01 16:42:34.051562 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 160/310] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:33 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1503 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:34.062595 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ceb27a30-9e60-44b4-94a2-9afb4aa7d68c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a2c6441-e1f8-4945-9e20-14b99d7e0484"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:34.063751 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ceb27a30-9e60-44b4-94a2-9afb4aa7d68c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:34.070076 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ceb27a30-9e60-44b4-94a2-9afb4aa7d68c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:34.070571 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ceb27a30-9e60-44b4-94a2-9afb4aa7d68c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:34.071344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ceb27a30-9e60-44b4-94a2-9afb4aa7d68c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:34.071781 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ceb27a30-9e60-44b4-94a2-9afb4aa7d68c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:34.100320 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-ceb27a30-9e60-44b4-94a2-9afb4aa7d68c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] HTTP exception thrown: Cannot 'attach_volume' instance ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 while it is in vm_state rescued Jul 01 16:42:34.103379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ceb27a30-9e60-44b4-94a2-9afb4aa7d68c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Request method failure captured: Jul 01 16:42:34.103379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: POST /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956/os-volume_attachments HTTP/1.1 Jul 01 16:42:34.103379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:42:34.103379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:42:34.103379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:42:34.103379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 74 Jul 01 16:42:34.103379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:42:34.103379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:42:34.103379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:42:34.103379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:42:34.103379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyOI-s3iPDB4YLflXSSRZWcau0vhHiVagbazYRJFMf9-OokthaqI0R_YfsAgJ8HN57hiV6pLMlhwp8sGg5hnPn2V7hGYaEstnvtMh8Gwcl3eCgjot-5oXe0pZAz2Wj1DG2Utw8Q4W96USbDVD_e5F1KghjdjHfBU_BAZG2dmgSw5D10 Jul 01 16:42:34.103379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:42:34.103379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:42:34.103379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:42:34.103379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:42:34.103379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:42:34.103379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:42:34.103379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: bf55d220c94d4445af9f73c532029e42 Jul 01 16:42:34.103379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1802263634 Jul 01 16:42:34.103379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:42:34.103379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:42:34.104937 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bf55d220c94d4445af9f73c532029e42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bf55d220c94d4445af9f73c532029e42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bf55d220c94d4445af9f73c532029e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bf55d220c94d4445af9f73c532029e42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:42:34.104937 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1802263634 Jul 01 16:42:34.104937 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: bf55d220c94d4445af9f73c532029e42 Jul 01 16:42:34.104937 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1802263634 Jul 01 16:42:34.104937 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-ServerRescueNegativeTestJSON-1802263634-project Jul 01 16:42:34.104937 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:42:34.104937 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:42:34.104937 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: 71c383c04f9543d8ab97a6c0db268ca5 Jul 01 16:42:34.104937 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1802263634-project Jul 01 16:42:34.104937 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Jul 01 16:42:34.104937 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {"volumeAttachment": {"volumeId": "9a2c6441-e1f8-4945-9e20-14b99d7e0484"}} Jul 01 16:42:34.104937 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:42:34.105833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Cannot 'attach_volume' instance ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 while it is in vm_state rescued Jul 01 16:42:34.105833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'server_id': 'ccdab81c-96e6-4936-8bd6-fe8a3ea5e956', 'body': {'volumeAttachment': {'volumeId': '9a2c6441-e1f8-4945-9e20-14b99d7e0484'}}} Jul 01 16:42:34.105833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:42:34.105833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:42:34.105833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 01 16:42:34.105833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 01 16:42:34.105833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 16:42:34.105833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 16:42:34.105833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 16:42:34.105833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 16:42:34.105833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 01 16:42:34.105833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:42:34.105833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:42:34.105833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:42:34.105833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:42:34.105833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:42:34.105833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:42:34.105833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:42:34.105833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:42:34.107436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:42:34.107436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:42:34.107436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 16:42:34.107436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 16:42:34.107436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 16:42:34.107436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 16:42:34.107436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 16:42:34.107436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 16:42:34.107436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 01 16:42:34.107436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 16:42:34.107436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 16:42:34.107436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 16:42:34.107436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 while it is in vm_state rescued Jul 01 16:42:34.107436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:42:34.107436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:42:34.107436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:42:34.107436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:42:34.107436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:42:34.107436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:42:34.109578 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:42:34.109578 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:42:34.109578 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 while it is in vm_state rescued Jul 01 16:42:34.109578 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:42:34.109578 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ceb27a30-9e60-44b4-94a2-9afb4aa7d68c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Returning 409 to user: Cannot 'attach_volume' instance ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 while it is in vm_state rescued {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:42:34.109578 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ceb27a30-9e60-44b4-94a2-9afb4aa7d68c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "POST /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047765 Jul 01 16:42:34.109578 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 151/311] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 1 16:42:34 2022] POST /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 01 16:42:34.116684 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-eab1344b-ab03-443b-9e28-486e04585710 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:34.117223 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-eab1344b-ab03-443b-9e28-486e04585710 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:34.127024 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eab1344b-ab03-443b-9e28-486e04585710 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:34.127376 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eab1344b-ab03-443b-9e28-486e04585710 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:34.128155 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eab1344b-ab03-443b-9e28-486e04585710 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:34.128594 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eab1344b-ab03-443b-9e28-486e04585710 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:34.228074 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-eab1344b-ab03-443b-9e28-486e04585710 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "POST /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956/action" status: 202 len: 0 microversion: 2.1 time: 0.115083 Jul 01 16:42:34.229886 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 161/312] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 1 16:42:34 2022] POST /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 16:42:34.238617 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3b69717c-de33-4c1a-9dad-7d0a00708853 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:34.239116 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3b69717c-de33-4c1a-9dad-7d0a00708853 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:34.252293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3b69717c-de33-4c1a-9dad-7d0a00708853 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:34.252909 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3b69717c-de33-4c1a-9dad-7d0a00708853 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:34.254298 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3b69717c-de33-4c1a-9dad-7d0a00708853 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:34.254854 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3b69717c-de33-4c1a-9dad-7d0a00708853 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:34.560314 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3b69717c-de33-4c1a-9dad-7d0a00708853 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:34.587645 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3b69717c-de33-4c1a-9dad-7d0a00708853 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1511 microversion: 2.1 time: 0.345435 Jul 01 16:42:34.588453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 152/313] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:34 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1511 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:34.803432 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3a919f8b-ddb3-44fc-a593-635b59015502 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:34.805330 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3a919f8b-ddb3-44fc-a593-635b59015502 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:34.822201 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3a919f8b-ddb3-44fc-a593-635b59015502 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:34.824439 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3a919f8b-ddb3-44fc-a593-635b59015502 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:34.825971 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5fd0e041-2bae-4d0d-ad32-a6cc1a333fac tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:34.826605 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5fd0e041-2bae-4d0d-ad32-a6cc1a333fac tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:34.827618 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3a919f8b-ddb3-44fc-a593-635b59015502 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:34.831660 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3a919f8b-ddb3-44fc-a593-635b59015502 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:34.855130 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5fd0e041-2bae-4d0d-ad32-a6cc1a333fac tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:34.855718 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5fd0e041-2bae-4d0d-ad32-a6cc1a333fac tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:34.856946 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5fd0e041-2bae-4d0d-ad32-a6cc1a333fac tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:34.857686 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5fd0e041-2bae-4d0d-ad32-a6cc1a333fac tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:35.465666 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3a919f8b-ddb3-44fc-a593-635b59015502 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:35.481139 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5fd0e041-2bae-4d0d-ad32-a6cc1a333fac tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:35.484337 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3a919f8b-ddb3-44fc-a593-635b59015502 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1366 microversion: 2.1 time: 0.684551 Jul 01 16:42:35.494497 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5fd0e041-2bae-4d0d-ad32-a6cc1a333fac tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:35.497140 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 162/314] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:34 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1366 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:35.509776 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b73ec77d-d013-486e-92f1-3afce1c4a7ce tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:35.511789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b73ec77d-d013-486e-92f1-3afce1c4a7ce tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:35.533687 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b73ec77d-d013-486e-92f1-3afce1c4a7ce tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:35.534545 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b73ec77d-d013-486e-92f1-3afce1c4a7ce tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:35.535566 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b73ec77d-d013-486e-92f1-3afce1c4a7ce tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:35.536144 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b73ec77d-d013-486e-92f1-3afce1c4a7ce tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:35.556284 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5fd0e041-2bae-4d0d-ad32-a6cc1a333fac tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:35.558208 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5fd0e041-2bae-4d0d-ad32-a6cc1a333fac tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1737 microversion: 2.20 time: 0.737483 Jul 01 16:42:35.559922 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 153/315] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:34 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1737 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:42:35.606279 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4540f217-9541-437e-8118-d603087c5aae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:35.608016 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4540f217-9541-437e-8118-d603087c5aae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:35.624539 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4540f217-9541-437e-8118-d603087c5aae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:35.625611 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4540f217-9541-437e-8118-d603087c5aae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:35.630415 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4540f217-9541-437e-8118-d603087c5aae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:35.631372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4540f217-9541-437e-8118-d603087c5aae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:35.739555 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b73ec77d-d013-486e-92f1-3afce1c4a7ce tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:35.751402 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b73ec77d-d013-486e-92f1-3afce1c4a7ce tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1271 microversion: 2.1 time: 0.243547 Jul 01 16:42:35.753988 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 163/316] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:35 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1271 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:35.960617 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4540f217-9541-437e-8118-d603087c5aae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:35.974524 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4540f217-9541-437e-8118-d603087c5aae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1511 microversion: 2.1 time: 0.373099 Jul 01 16:42:35.984829 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 154/317] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:35 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1511 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:36.505515 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-18854ad7-3808-469f-8367-f836517cb61c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:36.507045 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-18854ad7-3808-469f-8367-f836517cb61c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:36.533094 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-18854ad7-3808-469f-8367-f836517cb61c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:36.540114 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-18854ad7-3808-469f-8367-f836517cb61c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:36.544219 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-18854ad7-3808-469f-8367-f836517cb61c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:36.545468 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-18854ad7-3808-469f-8367-f836517cb61c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:36.579846 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3ac9b7b4-9da0-4233-a597-9dfaaa068065 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:36.581239 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3ac9b7b4-9da0-4233-a597-9dfaaa068065 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:36.604146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3ac9b7b4-9da0-4233-a597-9dfaaa068065 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:36.604910 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3ac9b7b4-9da0-4233-a597-9dfaaa068065 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:36.606709 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3ac9b7b4-9da0-4233-a597-9dfaaa068065 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:36.609087 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3ac9b7b4-9da0-4233-a597-9dfaaa068065 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:36.892015 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-18854ad7-3808-469f-8367-f836517cb61c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:36.908608 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-18854ad7-3808-469f-8367-f836517cb61c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1366 microversion: 2.1 time: 0.408392 Jul 01 16:42:36.920266 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 164/318] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:36 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1366 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:36.920266 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-844ac5c2-6f0d-4807-b6f6-8cb5d869b3b7 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:36.927112 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-844ac5c2-6f0d-4807-b6f6-8cb5d869b3b7 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:36.934996 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-844ac5c2-6f0d-4807-b6f6-8cb5d869b3b7 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:36.935450 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-844ac5c2-6f0d-4807-b6f6-8cb5d869b3b7 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:36.936349 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-844ac5c2-6f0d-4807-b6f6-8cb5d869b3b7 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:36.937923 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-844ac5c2-6f0d-4807-b6f6-8cb5d869b3b7 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:37.102570 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-844ac5c2-6f0d-4807-b6f6-8cb5d869b3b7 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:37.115444 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3ac9b7b4-9da0-4233-a597-9dfaaa068065 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:37.116447 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-844ac5c2-6f0d-4807-b6f6-8cb5d869b3b7 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1271 microversion: 2.1 time: 0.205030 Jul 01 16:42:37.118264 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 165/319] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:36 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1271 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:37.124780 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-46d401f4-ea19-4adc-bb87-0e25aa420586 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:37.125785 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-46d401f4-ea19-4adc-bb87-0e25aa420586 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:37.131223 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3ac9b7b4-9da0-4233-a597-9dfaaa068065 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:37.133632 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-46d401f4-ea19-4adc-bb87-0e25aa420586 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:37.133751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-46d401f4-ea19-4adc-bb87-0e25aa420586 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:37.141463 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3ac9b7b4-9da0-4233-a597-9dfaaa068065 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:37.142726 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3ac9b7b4-9da0-4233-a597-9dfaaa068065 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1737 microversion: 2.20 time: 0.569505 Jul 01 16:42:37.143769 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 155/320] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:36 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1737 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:42:37.147522 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-46d401f4-ea19-4adc-bb87-0e25aa420586 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:37.148387 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-46d401f4-ea19-4adc-bb87-0e25aa420586 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:37.367687 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-46d401f4-ea19-4adc-bb87-0e25aa420586 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:37.380274 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-46d401f4-ea19-4adc-bb87-0e25aa420586 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1511 microversion: 2.1 time: 0.260123 Jul 01 16:42:37.384977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 166/321] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:37 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1511 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:37.548147 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-909ed766-a740-4b57-9366-58d5e53190b4 req-a942d3d7-0a20-4899-9f86-89224f16f55c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d475a49d-1ee9-4cb0-aaea-507155a02204", "name": "network-vif-plugged", "status": "completed", "tag": "b942fa2d-b73f-482d-a3fc-1e5162c3f4a5"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:37.563897 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-909ed766-a740-4b57-9366-58d5e53190b4 req-a942d3d7-0a20-4899-9f86-89224f16f55c service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:37.564444 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-909ed766-a740-4b57-9366-58d5e53190b4 req-a942d3d7-0a20-4899-9f86-89224f16f55c service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:37.607617 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-909ed766-a740-4b57-9366-58d5e53190b4 req-a942d3d7-0a20-4899-9f86-89224f16f55c service nova] Creating event network-vif-plugged:b942fa2d-b73f-482d-a3fc-1e5162c3f4a5 for instance d475a49d-1ee9-4cb0-aaea-507155a02204 on hv-cinder-79760 Jul 01 16:42:37.621358 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-909ed766-a740-4b57-9366-58d5e53190b4 req-a942d3d7-0a20-4899-9f86-89224f16f55c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077063 Jul 01 16:42:37.623100 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 156/322] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:42:37.929077 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8c9b03fa-496b-4c8a-a5a9-d821741e37e5 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:37.934079 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8c9b03fa-496b-4c8a-a5a9-d821741e37e5 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:37.942512 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8c9b03fa-496b-4c8a-a5a9-d821741e37e5 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:37.944902 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8c9b03fa-496b-4c8a-a5a9-d821741e37e5 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:37.946024 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8c9b03fa-496b-4c8a-a5a9-d821741e37e5 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:37.946727 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8c9b03fa-496b-4c8a-a5a9-d821741e37e5 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:38.135008 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-bdc52cb7-ff44-4d5d-81a4-2deffae490e3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:38.136005 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-bdc52cb7-ff44-4d5d-81a4-2deffae490e3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:38.156570 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bdc52cb7-ff44-4d5d-81a4-2deffae490e3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:38.157435 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bdc52cb7-ff44-4d5d-81a4-2deffae490e3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:38.161111 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bdc52cb7-ff44-4d5d-81a4-2deffae490e3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:38.161832 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bdc52cb7-ff44-4d5d-81a4-2deffae490e3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:38.193188 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:38.202628 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8c9b03fa-496b-4c8a-a5a9-d821741e37e5 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:38.216291 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8c9b03fa-496b-4c8a-a5a9-d821741e37e5 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1366 microversion: 2.1 time: 0.291267 Jul 01 16:42:38.220274 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 167/323] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:37 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:38.238331 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-68fa2a3c-550a-4391-b81a-8e9b6fb149ae tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:38.239262 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-68fa2a3c-550a-4391-b81a-8e9b6fb149ae tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:38.254069 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-68fa2a3c-550a-4391-b81a-8e9b6fb149ae tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:38.259676 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-68fa2a3c-550a-4391-b81a-8e9b6fb149ae tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:38.261697 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-68fa2a3c-550a-4391-b81a-8e9b6fb149ae tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:38.263490 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-68fa2a3c-550a-4391-b81a-8e9b6fb149ae tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:38.558182 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bdc52cb7-ff44-4d5d-81a4-2deffae490e3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:38.579405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-bdc52cb7-ff44-4d5d-81a4-2deffae490e3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1313 microversion: 2.1 time: 0.448777 Jul 01 16:42:38.580004 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 157/324] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:38 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1313 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:38.610953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0169c3c9-4a70-46bf-a6a0-673839d85a15 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:38.611768 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0169c3c9-4a70-46bf-a6a0-673839d85a15 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:38.621505 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0169c3c9-4a70-46bf-a6a0-673839d85a15 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:38.622103 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0169c3c9-4a70-46bf-a6a0-673839d85a15 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:38.625279 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0169c3c9-4a70-46bf-a6a0-673839d85a15 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:38.625814 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0169c3c9-4a70-46bf-a6a0-673839d85a15 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:38.641337 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-68fa2a3c-550a-4391-b81a-8e9b6fb149ae tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:38.652188 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-68fa2a3c-550a-4391-b81a-8e9b6fb149ae tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:38.654166 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-68fa2a3c-550a-4391-b81a-8e9b6fb149ae tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:38.658478 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-68fa2a3c-550a-4391-b81a-8e9b6fb149ae tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1737 microversion: 2.20 time: 0.421614 Jul 01 16:42:38.659570 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 168/325] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:38 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1737 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:38.891943 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0169c3c9-4a70-46bf-a6a0-673839d85a15 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:38.900685 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0169c3c9-4a70-46bf-a6a0-673839d85a15 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1517 microversion: 2.1 time: 0.307500 Jul 01 16:42:38.910854 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 158/326] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:38 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1517 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:39.244224 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-697efa30-4680-4417-b502-ad403e6ce3ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:39.244838 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-697efa30-4680-4417-b502-ad403e6ce3ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:39.256231 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-697efa30-4680-4417-b502-ad403e6ce3ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:39.258052 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-697efa30-4680-4417-b502-ad403e6ce3ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:39.260307 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-697efa30-4680-4417-b502-ad403e6ce3ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:39.262012 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-697efa30-4680-4417-b502-ad403e6ce3ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:39.597840 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-68ce8652-9a95-4d68-a8e9-3e7f18b9b9d1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:39.598908 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-68ce8652-9a95-4d68-a8e9-3e7f18b9b9d1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:39.615241 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-68ce8652-9a95-4d68-a8e9-3e7f18b9b9d1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:39.617107 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-68ce8652-9a95-4d68-a8e9-3e7f18b9b9d1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:39.620418 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-68ce8652-9a95-4d68-a8e9-3e7f18b9b9d1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:39.621059 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-68ce8652-9a95-4d68-a8e9-3e7f18b9b9d1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:39.627672 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-697efa30-4680-4417-b502-ad403e6ce3ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:39.643287 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-697efa30-4680-4417-b502-ad403e6ce3ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1366 microversion: 2.1 time: 0.410475 Jul 01 16:42:39.657821 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 169/327] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:39 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:39.679281 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-12abcfc6-7a12-4584-b536-0454919805cf tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:39.680367 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-12abcfc6-7a12-4584-b536-0454919805cf tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:39.718209 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-12abcfc6-7a12-4584-b536-0454919805cf tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:39.720497 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-12abcfc6-7a12-4584-b536-0454919805cf tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:39.723846 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-12abcfc6-7a12-4584-b536-0454919805cf tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:39.725340 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-12abcfc6-7a12-4584-b536-0454919805cf tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:40.045835 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-68ce8652-9a95-4d68-a8e9-3e7f18b9b9d1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:40.055335 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-68ce8652-9a95-4d68-a8e9-3e7f18b9b9d1 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1313 microversion: 2.1 time: 0.461489 Jul 01 16:42:40.064219 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 159/328] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:39 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:40.096052 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-12abcfc6-7a12-4584-b536-0454919805cf tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:40.109888 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-12abcfc6-7a12-4584-b536-0454919805cf tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:40.111671 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-12abcfc6-7a12-4584-b536-0454919805cf tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:40.113502 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-12abcfc6-7a12-4584-b536-0454919805cf tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1737 microversion: 2.20 time: 0.438369 Jul 01 16:42:40.114689 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 170/329] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:39 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1737 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:40.377008 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-073f57fb-727c-4c37-840c-1297b4f61e9d req-77965fbb-d65c-448e-98ef-dd7ebabb9e2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9ae1288-04e2-4b2e-a52a-f74e91635ebd", "tag": "a3b0c557-db2a-4027-8b65-b4fb36645ae7"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:40.390839 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-073f57fb-727c-4c37-840c-1297b4f61e9d req-77965fbb-d65c-448e-98ef-dd7ebabb9e2b service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:40.391606 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-073f57fb-727c-4c37-840c-1297b4f61e9d req-77965fbb-d65c-448e-98ef-dd7ebabb9e2b service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:40.433750 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-073f57fb-727c-4c37-840c-1297b4f61e9d req-77965fbb-d65c-448e-98ef-dd7ebabb9e2b service nova] Creating event network-changed:a3b0c557-db2a-4027-8b65-b4fb36645ae7 for instance f9ae1288-04e2-4b2e-a52a-f74e91635ebd on hv-cinder-79760 Jul 01 16:42:40.445761 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-073f57fb-727c-4c37-840c-1297b4f61e9d req-77965fbb-d65c-448e-98ef-dd7ebabb9e2b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075184 Jul 01 16:42:40.446373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 160/330] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:42:40.657530 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2ba4bdf2-7c93-4a18-bbcd-25ce6702d590 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Action: 'create', calling method: .version_select at 0x7fa85f5b5ca0>, body: {"keypair": {"name": "tempest-keypair-1060489518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVZoYNPVsKVqt/YqfxURrMxV1aRzrb2pV+R+iY8qRE6TDOO4MmWj2hqnt3/1pYcCEd+tx6CiRPmqMhFkavgCF1rGh5FVw54HrSruWcp2+KKHdJVDdWEZd/JU/a0JSRIVg=="}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:40.662598 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f8f951ec-3c50-4da8-b779-30904736fa1f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:40.663314 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f8f951ec-3c50-4da8-b779-30904736fa1f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:40.688994 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f8f951ec-3c50-4da8-b779-30904736fa1f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:40.690897 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f8f951ec-3c50-4da8-b779-30904736fa1f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:40.692787 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f8f951ec-3c50-4da8-b779-30904736fa1f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:40.693895 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f8f951ec-3c50-4da8-b779-30904736fa1f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:40.722684 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-2ba4bdf2-7c93-4a18-bbcd-25ce6702d590 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Getting quotas for project bf55d220c94d4445af9f73c532029e42. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:42:40.727291 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:40.741507 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-2ba4bdf2-7c93-4a18-bbcd-25ce6702d590 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Getting quotas for user 71c383c04f9543d8ab97a6c0db268ca5 and project bf55d220c94d4445af9f73c532029e42. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:42:40.812861 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2ba4bdf2-7c93-4a18-bbcd-25ce6702d590 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.163711 Jul 01 16:42:40.813734 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 171/331] 10.222.0.57 () {60 vars in 1158 bytes} [Fri Jul 1 16:42:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:42:40.982024 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f8f951ec-3c50-4da8-b779-30904736fa1f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:40.992724 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f8f951ec-3c50-4da8-b779-30904736fa1f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1366 microversion: 2.1 time: 0.334326 Jul 01 16:42:41.004928 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 161/332] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:40 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:41.089346 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2708a5f8-446c-4b5a-a749-6ddf3827df83 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:41.090338 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2708a5f8-446c-4b5a-a749-6ddf3827df83 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:41.111823 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2708a5f8-446c-4b5a-a749-6ddf3827df83 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:41.113444 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2708a5f8-446c-4b5a-a749-6ddf3827df83 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:41.117384 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2708a5f8-446c-4b5a-a749-6ddf3827df83 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:41.118162 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2708a5f8-446c-4b5a-a749-6ddf3827df83 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:41.133751 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2530086e-00b5-4dd8-a13a-c437ee6a6f4e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:41.134544 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2530086e-00b5-4dd8-a13a-c437ee6a6f4e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:41.145748 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2530086e-00b5-4dd8-a13a-c437ee6a6f4e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:41.155772 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2530086e-00b5-4dd8-a13a-c437ee6a6f4e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:41.158771 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2530086e-00b5-4dd8-a13a-c437ee6a6f4e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:41.160669 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2530086e-00b5-4dd8-a13a-c437ee6a6f4e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:41.433385 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2708a5f8-446c-4b5a-a749-6ddf3827df83 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:41.438268 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:41.445725 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2708a5f8-446c-4b5a-a749-6ddf3827df83 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1313 microversion: 2.1 time: 0.364456 Jul 01 16:42:41.450820 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 172/333] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:41 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1313 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:41.521055 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2530086e-00b5-4dd8-a13a-c437ee6a6f4e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:41.532211 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2530086e-00b5-4dd8-a13a-c437ee6a6f4e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:41.534664 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2530086e-00b5-4dd8-a13a-c437ee6a6f4e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:41.536661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2530086e-00b5-4dd8-a13a-c437ee6a6f4e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1737 microversion: 2.20 time: 0.406974 Jul 01 16:42:41.549628 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 162/334] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:41 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1737 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:42:42.009823 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c6cdc396-d48c-4141-b927-3a1df1bae94c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:42.010605 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c6cdc396-d48c-4141-b927-3a1df1bae94c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:42.019526 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c6cdc396-d48c-4141-b927-3a1df1bae94c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:42.019975 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c6cdc396-d48c-4141-b927-3a1df1bae94c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:42.020760 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c6cdc396-d48c-4141-b927-3a1df1bae94c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:42.021195 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c6cdc396-d48c-4141-b927-3a1df1bae94c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:42.251564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c6cdc396-d48c-4141-b927-3a1df1bae94c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:42.260672 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c6cdc396-d48c-4141-b927-3a1df1bae94c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1556 microversion: 2.1 time: 0.254599 Jul 01 16:42:42.271023 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 173/335] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:42 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1556 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:42.284460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0ed402d8-a877-4d97-9af8-d4c0c3b6dd8d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:42.284987 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0ed402d8-a877-4d97-9af8-d4c0c3b6dd8d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:42.321594 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0ed402d8-a877-4d97-9af8-d4c0c3b6dd8d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:42.323875 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0ed402d8-a877-4d97-9af8-d4c0c3b6dd8d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:42.324773 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0ed402d8-a877-4d97-9af8-d4c0c3b6dd8d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:42.331173 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0ed402d8-a877-4d97-9af8-d4c0c3b6dd8d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:42.478144 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-05f6ebd6-1dc8-472b-8964-da38be75cd1e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:42.478970 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-05f6ebd6-1dc8-472b-8964-da38be75cd1e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:42.499702 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-05f6ebd6-1dc8-472b-8964-da38be75cd1e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:42.500653 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-05f6ebd6-1dc8-472b-8964-da38be75cd1e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:42.503809 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-05f6ebd6-1dc8-472b-8964-da38be75cd1e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:42.504491 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-05f6ebd6-1dc8-472b-8964-da38be75cd1e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:43.083467 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0ed402d8-a877-4d97-9af8-d4c0c3b6dd8d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.806922 Jul 01 16:42:43.085077 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 163/336] 10.222.0.57 () {58 vars in 1274 bytes} [Fri Jul 1 16:42:42 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204/os-interface => generated 284 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:42:43.090664 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-164a2fe8-3636-49b1-9033-c8d24f67928b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:43.091661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-164a2fe8-3636-49b1-9033-c8d24f67928b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:43.106648 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-164a2fe8-3636-49b1-9033-c8d24f67928b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:43.109078 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-164a2fe8-3636-49b1-9033-c8d24f67928b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:43.110034 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-164a2fe8-3636-49b1-9033-c8d24f67928b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:43.112202 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-164a2fe8-3636-49b1-9033-c8d24f67928b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:43.206873 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-05f6ebd6-1dc8-472b-8964-da38be75cd1e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:43.219412 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-05f6ebd6-1dc8-472b-8964-da38be75cd1e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1313 microversion: 2.1 time: 0.754828 Jul 01 16:42:43.226206 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 174/337] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:42 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1313 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:43.425214 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-164a2fe8-3636-49b1-9033-c8d24f67928b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:43.438436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-164a2fe8-3636-49b1-9033-c8d24f67928b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:43.440749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-164a2fe8-3636-49b1-9033-c8d24f67928b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:43.442425 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-164a2fe8-3636-49b1-9033-c8d24f67928b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1737 microversion: 2.20 time: 0.355926 Jul 01 16:42:43.443152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 164/338] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:43 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1737 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:43.801783 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3a1dd34f-96c5-4ece-aa6d-1264d20aa5fb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:43.802432 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3a1dd34f-96c5-4ece-aa6d-1264d20aa5fb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:43.811811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=6 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:43.819756 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3a1dd34f-96c5-4ece-aa6d-1264d20aa5fb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:43.820171 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3a1dd34f-96c5-4ece-aa6d-1264d20aa5fb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:43.830778 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3a1dd34f-96c5-4ece-aa6d-1264d20aa5fb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:43.831243 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3a1dd34f-96c5-4ece-aa6d-1264d20aa5fb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:44.197274 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3a1dd34f-96c5-4ece-aa6d-1264d20aa5fb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:44.216539 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3a1dd34f-96c5-4ece-aa6d-1264d20aa5fb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1594 microversion: 2.1 time: 0.418309 Jul 01 16:42:44.236477 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 175/339] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:43 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1594 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:44.244093 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c9022815-1949-42bf-a2d3-c27d67d22326 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:44.244710 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c9022815-1949-42bf-a2d3-c27d67d22326 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:44.249686 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:44.266239 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c9022815-1949-42bf-a2d3-c27d67d22326 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:44.286050 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c9022815-1949-42bf-a2d3-c27d67d22326 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:44.287569 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c9022815-1949-42bf-a2d3-c27d67d22326 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:44.288601 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c9022815-1949-42bf-a2d3-c27d67d22326 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:44.370459 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f06a8473-cf4f-4717-bf86-4d16ed9f2277 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-349671404", "imageRef": "42a4b1a9-dea6-4c87-a2c1-328b9c0c8558", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "40bcc3f6-35b7-411b-aab1-54f20941aafb"}], "security_groups": [{"name": "tempest-securitygroup--39865379"}], "key_name": "tempest-keypair-1060489518", "user_data": "}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:44.739056 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c9022815-1949-42bf-a2d3-c27d67d22326 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:44.757710 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-f06a8473-cf4f-4717-bf86-4d16ed9f2277 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] validate_networks() for [('40bcc3f6-35b7-411b-aab1-54f20941aafb', None, None, None, None, None)] {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 16:42:44.782412 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c9022815-1949-42bf-a2d3-c27d67d22326 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1313 microversion: 2.1 time: 0.541706 Jul 01 16:42:44.783897 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 165/340] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:44 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1313 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:44.792760 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4205c212-d29e-4e61-82f2-5058418c6b43 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:44.793885 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4205c212-d29e-4e61-82f2-5058418c6b43 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:44.810004 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4205c212-d29e-4e61-82f2-5058418c6b43 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:44.811578 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4205c212-d29e-4e61-82f2-5058418c6b43 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:44.820243 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4205c212-d29e-4e61-82f2-5058418c6b43 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:44.821174 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4205c212-d29e-4e61-82f2-5058418c6b43 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:45.917742 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4205c212-d29e-4e61-82f2-5058418c6b43 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:45.932494 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4205c212-d29e-4e61-82f2-5058418c6b43 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:45.934220 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4205c212-d29e-4e61-82f2-5058418c6b43 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:45.935785 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4205c212-d29e-4e61-82f2-5058418c6b43 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1737 microversion: 2.20 time: 1.150302 Jul 01 16:42:45.937555 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 166/341] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:44 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1737 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:45.944999 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-127ccc9b-b0a3-4c29-a787-cfc1088060d9 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:45.945610 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-127ccc9b-b0a3-4c29-a787-cfc1088060d9 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:45.963988 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-127ccc9b-b0a3-4c29-a787-cfc1088060d9 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:45.964777 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-127ccc9b-b0a3-4c29-a787-cfc1088060d9 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:45.965929 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-127ccc9b-b0a3-4c29-a787-cfc1088060d9 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:45.966556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-127ccc9b-b0a3-4c29-a787-cfc1088060d9 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:46.539725 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-127ccc9b-b0a3-4c29-a787-cfc1088060d9 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:46.565027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-127ccc9b-b0a3-4c29-a787-cfc1088060d9 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1313 microversion: 2.1 time: 0.625678 Jul 01 16:42:46.567986 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 167/342] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:45 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1313 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:46.606570 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-df7e6e3f-ffb7-44ee-b5a3-953ed6ddd0ec req-2156ddbd-2346-4026-b449-02b241e20a6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d475a49d-1ee9-4cb0-aaea-507155a02204", "tag": "b942fa2d-b73f-482d-a3fc-1e5162c3f4a5"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:46.657078 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-df7e6e3f-ffb7-44ee-b5a3-953ed6ddd0ec req-2156ddbd-2346-4026-b449-02b241e20a6a service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:46.657580 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-df7e6e3f-ffb7-44ee-b5a3-953ed6ddd0ec req-2156ddbd-2346-4026-b449-02b241e20a6a service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:46.689446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-df7e6e3f-ffb7-44ee-b5a3-953ed6ddd0ec req-2156ddbd-2346-4026-b449-02b241e20a6a service nova] Creating event network-changed:b942fa2d-b73f-482d-a3fc-1e5162c3f4a5 for instance d475a49d-1ee9-4cb0-aaea-507155a02204 on hv-cinder-79760 Jul 01 16:42:46.719893 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-df7e6e3f-ffb7-44ee-b5a3-953ed6ddd0ec req-2156ddbd-2346-4026-b449-02b241e20a6a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133833 Jul 01 16:42:46.721064 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 168/343] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:42:46.890384 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-f06a8473-cf4f-4717-bf86-4d16ed9f2277 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 16:42:46.890919 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-f06a8473-cf4f-4717-bf86-4d16ed9f2277 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 16:42:46.891654 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-f06a8473-cf4f-4717-bf86-4d16ed9f2277 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 16:42:46.892179 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-f06a8473-cf4f-4717-bf86-4d16ed9f2277 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 16:42:46.893698 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-f06a8473-cf4f-4717-bf86-4d16ed9f2277 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 16:42:46.913416 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f06a8473-cf4f-4717-bf86-4d16ed9f2277 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:46.915574 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f06a8473-cf4f-4717-bf86-4d16ed9f2277 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:46.917874 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f06a8473-cf4f-4717-bf86-4d16ed9f2277 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:46.918786 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f06a8473-cf4f-4717-bf86-4d16ed9f2277 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:46.955580 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4b5eac36-78bf-4481-96a3-4e4f078a1a9c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:46.956286 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4b5eac36-78bf-4481-96a3-4e4f078a1a9c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:46.963657 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4b5eac36-78bf-4481-96a3-4e4f078a1a9c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:46.964117 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4b5eac36-78bf-4481-96a3-4e4f078a1a9c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:46.965616 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4b5eac36-78bf-4481-96a3-4e4f078a1a9c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:46.966059 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4b5eac36-78bf-4481-96a3-4e4f078a1a9c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:46.973384 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-f06a8473-cf4f-4717-bf86-4d16ed9f2277 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Getting quotas for project bf55d220c94d4445af9f73c532029e42. Resources: {'ram', 'cores', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:42:46.982585 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-f06a8473-cf4f-4717-bf86-4d16ed9f2277 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Getting quotas for user 71c383c04f9543d8ab97a6c0db268ca5 and project bf55d220c94d4445af9f73c532029e42. Resources: {'ram', 'cores', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:42:47.010948 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f06a8473-cf4f-4717-bf86-4d16ed9f2277 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 16:42:47.017183 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f06a8473-cf4f-4717-bf86-4d16ed9f2277 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42a4b1a9-dea6-4c87-a2c1-328b9c0c8558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 16:42:47.127762 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f06a8473-cf4f-4717-bf86-4d16ed9f2277 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.763412 Jul 01 16:42:47.128909 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 176/344] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 1 16:42:44 2022] POST /compute/v2.1/servers => generated 407 bytes in 2765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 16:42:47.138475 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-dda3a2d6-41fc-44fd-98d7-46ecd081566d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:47.142067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-dda3a2d6-41fc-44fd-98d7-46ecd081566d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:47.361344 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-dda3a2d6-41fc-44fd-98d7-46ecd081566d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:47.368401 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-dda3a2d6-41fc-44fd-98d7-46ecd081566d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1245 microversion: 2.1 time: 0.233789 Jul 01 16:42:47.375610 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 177/345] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:47 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1245 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:47.447627 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4b5eac36-78bf-4481-96a3-4e4f078a1a9c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:47.459106 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4b5eac36-78bf-4481-96a3-4e4f078a1a9c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:47.468538 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4b5eac36-78bf-4481-96a3-4e4f078a1a9c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:47.469810 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4b5eac36-78bf-4481-96a3-4e4f078a1a9c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1737 microversion: 2.20 time: 0.519076 Jul 01 16:42:47.475263 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 169/346] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:46 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1737 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:47.595523 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-64be21f1-ca14-4782-8d8a-aff88e267fa7 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:47.596429 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-64be21f1-ca14-4782-8d8a-aff88e267fa7 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:47.630252 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-64be21f1-ca14-4782-8d8a-aff88e267fa7 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:47.630732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-64be21f1-ca14-4782-8d8a-aff88e267fa7 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:47.636513 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-64be21f1-ca14-4782-8d8a-aff88e267fa7 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:47.637132 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-64be21f1-ca14-4782-8d8a-aff88e267fa7 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:48.393559 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a7b1d0e5-d992-4225-aa9b-5c31db9024ab tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:48.394400 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a7b1d0e5-d992-4225-aa9b-5c31db9024ab tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:48.410463 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a7b1d0e5-d992-4225-aa9b-5c31db9024ab tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:48.411343 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a7b1d0e5-d992-4225-aa9b-5c31db9024ab tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:48.412349 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a7b1d0e5-d992-4225-aa9b-5c31db9024ab tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:48.413011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a7b1d0e5-d992-4225-aa9b-5c31db9024ab tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:48.732420 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-64be21f1-ca14-4782-8d8a-aff88e267fa7 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:48.745596 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-64be21f1-ca14-4782-8d8a-aff88e267fa7 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1313 microversion: 2.1 time: 1.163605 Jul 01 16:42:48.748983 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 178/347] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:47 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1313 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:48.757821 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-642cb297-4a60-4e61-8a95-bd8c9615b2ab tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:48.763707 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-642cb297-4a60-4e61-8a95-bd8c9615b2ab tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:48.782387 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-642cb297-4a60-4e61-8a95-bd8c9615b2ab tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:48.786832 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-642cb297-4a60-4e61-8a95-bd8c9615b2ab tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:48.796819 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-642cb297-4a60-4e61-8a95-bd8c9615b2ab tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:48.803086 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-642cb297-4a60-4e61-8a95-bd8c9615b2ab tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:48.819233 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a7b1d0e5-d992-4225-aa9b-5c31db9024ab tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:48.829786 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a7b1d0e5-d992-4225-aa9b-5c31db9024ab tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1241 microversion: 2.1 time: 0.441517 Jul 01 16:42:48.851885 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 170/348] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:48 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1241 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:49.084435 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-642cb297-4a60-4e61-8a95-bd8c9615b2ab tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:49.093939 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-642cb297-4a60-4e61-8a95-bd8c9615b2ab tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:49.102366 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-642cb297-4a60-4e61-8a95-bd8c9615b2ab tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:49.104378 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-642cb297-4a60-4e61-8a95-bd8c9615b2ab tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1737 microversion: 2.20 time: 0.353627 Jul 01 16:42:49.124719 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 179/349] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:48 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1737 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:49.763467 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-cc784c3f-c3e2-491e-8b82-287a9a9cff44 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:49.764719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-cc784c3f-c3e2-491e-8b82-287a9a9cff44 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:49.777138 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cc784c3f-c3e2-491e-8b82-287a9a9cff44 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:49.777612 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cc784c3f-c3e2-491e-8b82-287a9a9cff44 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:49.778397 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cc784c3f-c3e2-491e-8b82-287a9a9cff44 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:49.778901 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cc784c3f-c3e2-491e-8b82-287a9a9cff44 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:49.871166 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-97dd896a-8a4a-4c75-b587-6ce9e6e49ca9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:49.872584 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-97dd896a-8a4a-4c75-b587-6ce9e6e49ca9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:49.888174 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-97dd896a-8a4a-4c75-b587-6ce9e6e49ca9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:49.893408 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-97dd896a-8a4a-4c75-b587-6ce9e6e49ca9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:49.896270 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-97dd896a-8a4a-4c75-b587-6ce9e6e49ca9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:49.899169 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-97dd896a-8a4a-4c75-b587-6ce9e6e49ca9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:50.184120 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-97dd896a-8a4a-4c75-b587-6ce9e6e49ca9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:50.201933 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-97dd896a-8a4a-4c75-b587-6ce9e6e49ca9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1303 microversion: 2.1 time: 0.335584 Jul 01 16:42:50.203528 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 180/350] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:49 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1303 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:50.221560 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-aed40824-02f1-4c92-910f-caa4c9e17ebe tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:50.222768 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-aed40824-02f1-4c92-910f-caa4c9e17ebe tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:50.235280 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-aed40824-02f1-4c92-910f-caa4c9e17ebe tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:50.236345 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-aed40824-02f1-4c92-910f-caa4c9e17ebe tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:50.237506 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-aed40824-02f1-4c92-910f-caa4c9e17ebe tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:50.238671 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-aed40824-02f1-4c92-910f-caa4c9e17ebe tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:50.528579 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-cc784c3f-c3e2-491e-8b82-287a9a9cff44 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:50.554669 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-cc784c3f-c3e2-491e-8b82-287a9a9cff44 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1313 microversion: 2.1 time: 0.793338 Jul 01 16:42:50.567429 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 171/351] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:49 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1313 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:50.660036 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-aed40824-02f1-4c92-910f-caa4c9e17ebe tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:50.675401 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-aed40824-02f1-4c92-910f-caa4c9e17ebe tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:50.683966 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-aed40824-02f1-4c92-910f-caa4c9e17ebe tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:50.685185 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-aed40824-02f1-4c92-910f-caa4c9e17ebe tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1737 microversion: 2.20 time: 0.480642 Jul 01 16:42:50.689619 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 181/352] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:50 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1737 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:50.899727 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-5f5682e1-8c83-446d-90b3-b67c7c27eefe req-38edb346-9663-4c1f-a9e9-2b240340bd93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74fca065-c0ba-4a16-958e-a991e16bb913", "tag": "74960809-e36c-4511-9a63-5f955f9a40f0"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:50.939818 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-5f5682e1-8c83-446d-90b3-b67c7c27eefe req-38edb346-9663-4c1f-a9e9-2b240340bd93 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:50.940280 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-5f5682e1-8c83-446d-90b3-b67c7c27eefe req-38edb346-9663-4c1f-a9e9-2b240340bd93 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:50.980775 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-5f5682e1-8c83-446d-90b3-b67c7c27eefe req-38edb346-9663-4c1f-a9e9-2b240340bd93 service nova] Creating event network-changed:74960809-e36c-4511-9a63-5f955f9a40f0 for instance 74fca065-c0ba-4a16-958e-a991e16bb913 on hv-cinder-79760 Jul 01 16:42:50.995854 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-5f5682e1-8c83-446d-90b3-b67c7c27eefe req-38edb346-9663-4c1f-a9e9-2b240340bd93 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101179 Jul 01 16:42:50.997133 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 172/353] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:42:51.220738 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fff3ca59-7a4d-46d2-a880-f99cea3f13cc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:51.224759 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-fff3ca59-7a4d-46d2-a880-f99cea3f13cc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:51.252699 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fff3ca59-7a4d-46d2-a880-f99cea3f13cc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:51.260658 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fff3ca59-7a4d-46d2-a880-f99cea3f13cc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:51.262275 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fff3ca59-7a4d-46d2-a880-f99cea3f13cc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:51.262892 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fff3ca59-7a4d-46d2-a880-f99cea3f13cc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:51.577249 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a13e8c04-33cc-4d40-9caf-71ade7b7fca0 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:51.578979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a13e8c04-33cc-4d40-9caf-71ade7b7fca0 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:51.600395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a13e8c04-33cc-4d40-9caf-71ade7b7fca0 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:51.602811 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a13e8c04-33cc-4d40-9caf-71ade7b7fca0 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:51.603598 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a13e8c04-33cc-4d40-9caf-71ade7b7fca0 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:51.604032 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a13e8c04-33cc-4d40-9caf-71ade7b7fca0 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:51.654024 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fff3ca59-7a4d-46d2-a880-f99cea3f13cc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:51.665407 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fff3ca59-7a4d-46d2-a880-f99cea3f13cc tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1369 microversion: 2.1 time: 0.448922 Jul 01 16:42:51.671052 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 182/354] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:51 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1369 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:51.709912 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c2d90dda-b802-4d0b-8306-b165bc35ae31 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:51.710874 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c2d90dda-b802-4d0b-8306-b165bc35ae31 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:51.740302 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c2d90dda-b802-4d0b-8306-b165bc35ae31 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:51.741061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c2d90dda-b802-4d0b-8306-b165bc35ae31 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:51.742026 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c2d90dda-b802-4d0b-8306-b165bc35ae31 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:51.742648 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c2d90dda-b802-4d0b-8306-b165bc35ae31 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:52.385018 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a13e8c04-33cc-4d40-9caf-71ade7b7fca0 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:52.402591 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a13e8c04-33cc-4d40-9caf-71ade7b7fca0 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1313 microversion: 2.1 time: 0.830091 Jul 01 16:42:52.404744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 173/355] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:51 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1313 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:52.554804 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c2d90dda-b802-4d0b-8306-b165bc35ae31 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:52.565815 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c2d90dda-b802-4d0b-8306-b165bc35ae31 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:52.575185 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c2d90dda-b802-4d0b-8306-b165bc35ae31 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:52.580791 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c2d90dda-b802-4d0b-8306-b165bc35ae31 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1737 microversion: 2.20 time: 0.880627 Jul 01 16:42:52.598581 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 183/356] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:51 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1737 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:52.690211 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5dfd33f1-7c39-4b17-a263-835d474ead54 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:52.690955 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5dfd33f1-7c39-4b17-a263-835d474ead54 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:52.704659 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5dfd33f1-7c39-4b17-a263-835d474ead54 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:52.707040 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5dfd33f1-7c39-4b17-a263-835d474ead54 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:52.707849 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5dfd33f1-7c39-4b17-a263-835d474ead54 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:52.708315 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5dfd33f1-7c39-4b17-a263-835d474ead54 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:53.158143 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5dfd33f1-7c39-4b17-a263-835d474ead54 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:53.175331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5dfd33f1-7c39-4b17-a263-835d474ead54 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1369 microversion: 2.1 time: 0.490084 Jul 01 16:42:53.179888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 174/357] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:52 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1369 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:53.420980 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f3168e5b-a63f-4e0b-8f8f-fa713f675ce3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:53.421698 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f3168e5b-a63f-4e0b-8f8f-fa713f675ce3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:53.433242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f3168e5b-a63f-4e0b-8f8f-fa713f675ce3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:53.434624 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f3168e5b-a63f-4e0b-8f8f-fa713f675ce3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:53.439338 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f3168e5b-a63f-4e0b-8f8f-fa713f675ce3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:53.441743 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f3168e5b-a63f-4e0b-8f8f-fa713f675ce3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:53.602739 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-51a02ada-88fd-44c0-b766-00daab90ebc8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:53.603977 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-51a02ada-88fd-44c0-b766-00daab90ebc8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:53.612772 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-51a02ada-88fd-44c0-b766-00daab90ebc8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:53.618157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-51a02ada-88fd-44c0-b766-00daab90ebc8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:53.619444 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-51a02ada-88fd-44c0-b766-00daab90ebc8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:53.620055 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-51a02ada-88fd-44c0-b766-00daab90ebc8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:53.869508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-51a02ada-88fd-44c0-b766-00daab90ebc8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:53.889530 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-51a02ada-88fd-44c0-b766-00daab90ebc8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:53.896775 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-51a02ada-88fd-44c0-b766-00daab90ebc8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:53.898229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-51a02ada-88fd-44c0-b766-00daab90ebc8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1737 microversion: 2.20 time: 0.299396 Jul 01 16:42:53.902900 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 175/358] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:53 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1737 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:42:53.915434 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-59b01b34-1b11-45ce-8132-cfd7d2a94535 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1885870418"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:53.919115 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-59b01b34-1b11-45ce-8132-cfd7d2a94535 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:53.921918 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f3168e5b-a63f-4e0b-8f8f-fa713f675ce3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:53.929111 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-59b01b34-1b11-45ce-8132-cfd7d2a94535 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:53.930055 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-59b01b34-1b11-45ce-8132-cfd7d2a94535 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:53.932416 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-59b01b34-1b11-45ce-8132-cfd7d2a94535 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:53.932825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f3168e5b-a63f-4e0b-8f8f-fa713f675ce3 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1313 microversion: 2.1 time: 0.515694 Jul 01 16:42:53.933483 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-59b01b34-1b11-45ce-8132-cfd7d2a94535 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:53.936704 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=100 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:53.943023 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 184/359] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:53 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1313 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:54.146126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.network.security_group_api [None req-59b01b34-1b11-45ce-8132-cfd7d2a94535 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Adding security group dc4d8463-50b1-4283-a000-7cf20542b5c3 to port 74960809-e36c-4511-9a63-5f955f9a40f0 Jul 01 16:42:54.198330 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-02330d5a-98c1-4046-aa66-566f3cf443ea tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:54.199143 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-02330d5a-98c1-4046-aa66-566f3cf443ea tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:54.215313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-02330d5a-98c1-4046-aa66-566f3cf443ea tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:54.216187 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-02330d5a-98c1-4046-aa66-566f3cf443ea tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:54.218155 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-02330d5a-98c1-4046-aa66-566f3cf443ea tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:54.219472 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-02330d5a-98c1-4046-aa66-566f3cf443ea tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:54.422661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-02330d5a-98c1-4046-aa66-566f3cf443ea tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:54.434009 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-02330d5a-98c1-4046-aa66-566f3cf443ea tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1369 microversion: 2.1 time: 0.239649 Jul 01 16:42:54.436810 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 185/360] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:54 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1369 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:54.928074 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-86f0f2c3-b886-493a-ac89-cce2a7b8b03d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:54.937101 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-86f0f2c3-b886-493a-ac89-cce2a7b8b03d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:54.948028 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-86f0f2c3-b886-493a-ac89-cce2a7b8b03d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:54.948487 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-86f0f2c3-b886-493a-ac89-cce2a7b8b03d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:54.949279 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-86f0f2c3-b886-493a-ac89-cce2a7b8b03d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:54.952060 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-86f0f2c3-b886-493a-ac89-cce2a7b8b03d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:55.447831 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-86f0f2c3-b886-493a-ac89-cce2a7b8b03d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:55.460194 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-86f0f2c3-b886-493a-ac89-cce2a7b8b03d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:55.463557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-86f0f2c3-b886-493a-ac89-cce2a7b8b03d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:55.467098 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-86f0f2c3-b886-493a-ac89-cce2a7b8b03d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1737 microversion: 2.20 time: 0.548448 Jul 01 16:42:55.469959 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 186/361] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:54 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1737 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:55.480266 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c86045bc-5238-4b59-9e57-f6d095298063 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:55.481170 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c86045bc-5238-4b59-9e57-f6d095298063 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:55.502312 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c86045bc-5238-4b59-9e57-f6d095298063 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:55.502312 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c86045bc-5238-4b59-9e57-f6d095298063 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:55.502312 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c86045bc-5238-4b59-9e57-f6d095298063 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:55.504758 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c86045bc-5238-4b59-9e57-f6d095298063 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:55.590163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-59b01b34-1b11-45ce-8132-cfd7d2a94535 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "POST /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913/action" status: 202 len: 0 microversion: 2.1 time: 1.685091 Jul 01 16:42:55.591130 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 176/362] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 1 16:42:53 2022] POST /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913/action => generated 0 bytes in 1687 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:42:55.597336 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-99e7eb12-7746-467a-b15e-3aae39da25a3 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:55.598011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-99e7eb12-7746-467a-b15e-3aae39da25a3 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:55.623133 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-99e7eb12-7746-467a-b15e-3aae39da25a3 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:55.625369 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-99e7eb12-7746-467a-b15e-3aae39da25a3 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:55.626242 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-99e7eb12-7746-467a-b15e-3aae39da25a3 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:55.626954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-99e7eb12-7746-467a-b15e-3aae39da25a3 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:56.094800 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-99e7eb12-7746-467a-b15e-3aae39da25a3 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:56.102617 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-99e7eb12-7746-467a-b15e-3aae39da25a3 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1369 microversion: 2.1 time: 0.510374 Jul 01 16:42:56.103262 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 177/363] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:55 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1369 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:56.112594 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-373b419c-882d-4fe5-a43e-4bd396605c8d tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:56.113203 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-373b419c-882d-4fe5-a43e-4bd396605c8d tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:56.135457 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-373b419c-882d-4fe5-a43e-4bd396605c8d tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:56.135814 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-373b419c-882d-4fe5-a43e-4bd396605c8d tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:56.136582 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-373b419c-882d-4fe5-a43e-4bd396605c8d tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:56.137014 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-373b419c-882d-4fe5-a43e-4bd396605c8d tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:56.147685 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c86045bc-5238-4b59-9e57-f6d095298063 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:56.163186 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c86045bc-5238-4b59-9e57-f6d095298063 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1313 microversion: 2.1 time: 0.687118 Jul 01 16:42:56.166617 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 187/364] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:55 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1313 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:56.184002 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-2fc811f2-6de4-430f-a51b-f495d4a80885 req-869834c8-597f-4508-8b4b-3d1d14387cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74fca065-c0ba-4a16-958e-a991e16bb913", "tag": "74960809-e36c-4511-9a63-5f955f9a40f0"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:56.216418 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-2fc811f2-6de4-430f-a51b-f495d4a80885 req-869834c8-597f-4508-8b4b-3d1d14387cd6 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:56.222054 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-2fc811f2-6de4-430f-a51b-f495d4a80885 req-869834c8-597f-4508-8b4b-3d1d14387cd6 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:56.269104 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-2fc811f2-6de4-430f-a51b-f495d4a80885 req-869834c8-597f-4508-8b4b-3d1d14387cd6 service nova] Creating event network-changed:74960809-e36c-4511-9a63-5f955f9a40f0 for instance 74fca065-c0ba-4a16-958e-a991e16bb913 on hv-cinder-79760 Jul 01 16:42:56.298336 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-2fc811f2-6de4-430f-a51b-f495d4a80885 req-869834c8-597f-4508-8b4b-3d1d14387cd6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129950 Jul 01 16:42:56.299164 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 188/365] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:42:56.475905 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-373b419c-882d-4fe5-a43e-4bd396605c8d tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:56.485999 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-373b419c-882d-4fe5-a43e-4bd396605c8d tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1641 microversion: 2.1 time: 0.381695 Jul 01 16:42:56.486997 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 178/366] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:56 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1641 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:56.489464 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a65bc06d-68b2-4cf6-8ec4-af1f5650ad9d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:56.490752 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a65bc06d-68b2-4cf6-8ec4-af1f5650ad9d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:56.504636 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a65bc06d-68b2-4cf6-8ec4-af1f5650ad9d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:56.505573 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a65bc06d-68b2-4cf6-8ec4-af1f5650ad9d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:56.507070 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a65bc06d-68b2-4cf6-8ec4-af1f5650ad9d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:56.507738 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a65bc06d-68b2-4cf6-8ec4-af1f5650ad9d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:56.530596 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-85be72fc-1f96-4b04-af05-8bc56564b853 req-0b6f33df-b0d8-4ab0-a27e-f0135f692aac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f084bd09-4d9f-4dfc-8166-711a8c80cbee", "tag": "b1c38327-6c47-4d4f-bcc3-847a86785a63"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:56.543283 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-85be72fc-1f96-4b04-af05-8bc56564b853 req-0b6f33df-b0d8-4ab0-a27e-f0135f692aac service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:56.551638 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-85be72fc-1f96-4b04-af05-8bc56564b853 req-0b6f33df-b0d8-4ab0-a27e-f0135f692aac service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:56.572395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-85be72fc-1f96-4b04-af05-8bc56564b853 req-0b6f33df-b0d8-4ab0-a27e-f0135f692aac service nova] Creating event network-changed:b1c38327-6c47-4d4f-bcc3-847a86785a63 for instance f084bd09-4d9f-4dfc-8166-711a8c80cbee on hv-cinder-79760 Jul 01 16:42:56.589668 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-85be72fc-1f96-4b04-af05-8bc56564b853 req-0b6f33df-b0d8-4ab0-a27e-f0135f692aac service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063432 Jul 01 16:42:56.590980 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 179/367] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:42:56.821374 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a65bc06d-68b2-4cf6-8ec4-af1f5650ad9d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:56.838952 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a65bc06d-68b2-4cf6-8ec4-af1f5650ad9d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:56.838952 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a65bc06d-68b2-4cf6-8ec4-af1f5650ad9d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:56.838952 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a65bc06d-68b2-4cf6-8ec4-af1f5650ad9d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1737 microversion: 2.20 time: 0.352690 Jul 01 16:42:56.849375 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 189/368] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:56 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1737 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:57.129154 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-eda40058-b073-4448-a836-f36a0ed6011d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:57.130482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-eda40058-b073-4448-a836-f36a0ed6011d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:57.142214 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-eda40058-b073-4448-a836-f36a0ed6011d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:57.142764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-eda40058-b073-4448-a836-f36a0ed6011d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:57.144172 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-eda40058-b073-4448-a836-f36a0ed6011d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:57.144758 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-eda40058-b073-4448-a836-f36a0ed6011d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:57.184989 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ddad7d33-97d7-4e82-9361-637ad75ed92f tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:57.186609 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ddad7d33-97d7-4e82-9361-637ad75ed92f tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:57.191211 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:57.195552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ddad7d33-97d7-4e82-9361-637ad75ed92f tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:57.196555 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ddad7d33-97d7-4e82-9361-637ad75ed92f tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:57.197563 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ddad7d33-97d7-4e82-9361-637ad75ed92f tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:57.198194 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ddad7d33-97d7-4e82-9361-637ad75ed92f tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:57.369018 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=18 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:57.491795 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-eda40058-b073-4448-a836-f36a0ed6011d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:57.508031 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ddad7d33-97d7-4e82-9361-637ad75ed92f tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:57.514789 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-eda40058-b073-4448-a836-f36a0ed6011d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1369 microversion: 2.1 time: 0.384421 Jul 01 16:42:57.516917 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ddad7d33-97d7-4e82-9361-637ad75ed92f tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1313 microversion: 2.1 time: 0.337428 Jul 01 16:42:57.519032 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 190/369] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:57 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:57.524661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-26325fbe-0f61-4f43-a4ca-c6f9f957e315 req-6c575042-1e0e-4997-b913-151504eb9cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9ae1288-04e2-4b2e-a52a-f74e91635ebd", "name": "network-vif-plugged", "status": "completed", "tag": "a3b0c557-db2a-4027-8b65-b4fb36645ae7"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:42:57.525116 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 180/370] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:57 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1369 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:57.535038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-26325fbe-0f61-4f43-a4ca-c6f9f957e315 req-6c575042-1e0e-4997-b913-151504eb9cc7 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:57.536061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-26325fbe-0f61-4f43-a4ca-c6f9f957e315 req-6c575042-1e0e-4997-b913-151504eb9cc7 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:57.553274 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-26325fbe-0f61-4f43-a4ca-c6f9f957e315 req-6c575042-1e0e-4997-b913-151504eb9cc7 service nova] Creating event network-vif-plugged:a3b0c557-db2a-4027-8b65-b4fb36645ae7 for instance f9ae1288-04e2-4b2e-a52a-f74e91635ebd on hv-cinder-79760 Jul 01 16:42:57.558570 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-26325fbe-0f61-4f43-a4ca-c6f9f957e315 req-6c575042-1e0e-4997-b913-151504eb9cc7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038008 Jul 01 16:42:57.559182 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 191/371] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:42:57.856927 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c8d8b986-0789-4dcc-91fa-6bbd1d111e11 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:57.857633 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c8d8b986-0789-4dcc-91fa-6bbd1d111e11 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:57.868785 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c8d8b986-0789-4dcc-91fa-6bbd1d111e11 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:57.869615 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c8d8b986-0789-4dcc-91fa-6bbd1d111e11 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:57.870681 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c8d8b986-0789-4dcc-91fa-6bbd1d111e11 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:57.871325 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c8d8b986-0789-4dcc-91fa-6bbd1d111e11 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:58.026461 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c8d8b986-0789-4dcc-91fa-6bbd1d111e11 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:58.038150 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c8d8b986-0789-4dcc-91fa-6bbd1d111e11 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:58.039689 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c8d8b986-0789-4dcc-91fa-6bbd1d111e11 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:58.040997 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c8d8b986-0789-4dcc-91fa-6bbd1d111e11 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1719 microversion: 2.20 time: 0.189445 Jul 01 16:42:58.041559 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 181/372] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:57 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1719 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:58.534666 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-79942bb3-0229-41e9-a904-d9d9a756a56f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:58.535520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-79942bb3-0229-41e9-a904-d9d9a756a56f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:58.542069 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4861a5be-8df0-4fa0-add9-720d54f39a58 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:58.546840 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-79942bb3-0229-41e9-a904-d9d9a756a56f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:58.547011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4861a5be-8df0-4fa0-add9-720d54f39a58 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:58.547672 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-79942bb3-0229-41e9-a904-d9d9a756a56f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:58.567819 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4861a5be-8df0-4fa0-add9-720d54f39a58 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:58.570968 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4861a5be-8df0-4fa0-add9-720d54f39a58 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:58.571742 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-79942bb3-0229-41e9-a904-d9d9a756a56f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:58.572459 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-79942bb3-0229-41e9-a904-d9d9a756a56f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:58.574693 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4861a5be-8df0-4fa0-add9-720d54f39a58 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:58.575224 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4861a5be-8df0-4fa0-add9-720d54f39a58 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:58.628901 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=100 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:58.908658 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-79942bb3-0229-41e9-a904-d9d9a756a56f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:58.920070 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-79942bb3-0229-41e9-a904-d9d9a756a56f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1369 microversion: 2.1 time: 0.392523 Jul 01 16:42:58.921032 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 192/373] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:58 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1369 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:42:58.930733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4861a5be-8df0-4fa0-add9-720d54f39a58 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:58.943616 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4861a5be-8df0-4fa0-add9-720d54f39a58 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1313 microversion: 2.1 time: 0.410647 Jul 01 16:42:58.945344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 182/374] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:58 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:42:59.077507 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-eac94bbb-9e9c-4d98-8a3a-de6b879fdbb3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:59.078188 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-eac94bbb-9e9c-4d98-8a3a-de6b879fdbb3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:59.096033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eac94bbb-9e9c-4d98-8a3a-de6b879fdbb3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:59.096486 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eac94bbb-9e9c-4d98-8a3a-de6b879fdbb3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:59.097256 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eac94bbb-9e9c-4d98-8a3a-de6b879fdbb3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:59.097693 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eac94bbb-9e9c-4d98-8a3a-de6b879fdbb3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:59.241776 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-eac94bbb-9e9c-4d98-8a3a-de6b879fdbb3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:59.258691 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-eac94bbb-9e9c-4d98-8a3a-de6b879fdbb3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:59.260643 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-eac94bbb-9e9c-4d98-8a3a-de6b879fdbb3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:42:59.262098 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-eac94bbb-9e9c-4d98-8a3a-de6b879fdbb3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1719 microversion: 2.20 time: 0.196793 Jul 01 16:42:59.262898 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 193/375] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:42:59 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1719 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:42:59.937291 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9f850b1b-0ae7-4f24-8f14-bbced5d5625f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:59.937893 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-9f850b1b-0ae7-4f24-8f14-bbced5d5625f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:59.949564 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=86 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:59.953182 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9f850b1b-0ae7-4f24-8f14-bbced5d5625f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:59.962449 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0f158b2c-69bc-40dc-8dcf-4d3d0410d81e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:42:59.963329 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0f158b2c-69bc-40dc-8dcf-4d3d0410d81e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:42:59.971436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9f850b1b-0ae7-4f24-8f14-bbced5d5625f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:59.972630 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9f850b1b-0ae7-4f24-8f14-bbced5d5625f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:59.973154 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9f850b1b-0ae7-4f24-8f14-bbced5d5625f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:59.977048 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0f158b2c-69bc-40dc-8dcf-4d3d0410d81e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:59.984956 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0f158b2c-69bc-40dc-8dcf-4d3d0410d81e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:42:59.986046 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0f158b2c-69bc-40dc-8dcf-4d3d0410d81e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:42:59.986572 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0f158b2c-69bc-40dc-8dcf-4d3d0410d81e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:00.281600 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9f850b1b-0ae7-4f24-8f14-bbced5d5625f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:00.294320 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9f850b1b-0ae7-4f24-8f14-bbced5d5625f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1369 microversion: 2.1 time: 0.361063 Jul 01 16:43:00.297198 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 183/376] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:59 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1369 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:00.300746 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0f158b2c-69bc-40dc-8dcf-4d3d0410d81e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:00.309120 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0f158b2c-69bc-40dc-8dcf-4d3d0410d81e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1313 microversion: 2.1 time: 0.351670 Jul 01 16:43:00.319199 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 194/377] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:42:59 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:43:00.324842 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c8ebb5bd-9024-493e-b1fe-9074cb474ed4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:00.325608 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c8ebb5bd-9024-493e-b1fe-9074cb474ed4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:00.333312 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c8ebb5bd-9024-493e-b1fe-9074cb474ed4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:00.334214 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c8ebb5bd-9024-493e-b1fe-9074cb474ed4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:00.339516 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c8ebb5bd-9024-493e-b1fe-9074cb474ed4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:00.340184 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c8ebb5bd-9024-493e-b1fe-9074cb474ed4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:00.583150 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c8ebb5bd-9024-493e-b1fe-9074cb474ed4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:00.595791 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c8ebb5bd-9024-493e-b1fe-9074cb474ed4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:00.596643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-434f97c6-37ca-4814-b2c7-dfea9c07ee01 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Action: 'create', calling method: .version_select at 0x7fa86e48d9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1420297892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnqiH5LxZ2JJH052VROZPtUr29n9d34pTOMr8QyqgH+RgjjcOMIhvS0k9e2QoXKTdLdRKuNgES9FOHgRWV5UKRjdNJix0AihbuDnMBMJPxA24E2yOTRJsi7whGpau/LWw=="}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:43:00.598165 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c8ebb5bd-9024-493e-b1fe-9074cb474ed4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:00.599510 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c8ebb5bd-9024-493e-b1fe-9074cb474ed4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1719 microversion: 2.20 time: 0.279274 Jul 01 16:43:00.610436 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 195/378] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:00 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1719 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:00.615135 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-434f97c6-37ca-4814-b2c7-dfea9c07ee01 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Getting quotas for project 1eb9237b6e8a4b5ca032f0664d09f28e. Resources: {'key_pairs'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:43:00.620185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-434f97c6-37ca-4814-b2c7-dfea9c07ee01 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Getting quotas for user 5b62962ac2a14ae997fb637e80129beb and project 1eb9237b6e8a4b5ca032f0664d09f28e. Resources: {'key_pairs'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:43:00.646366 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-434f97c6-37ca-4814-b2c7-dfea9c07ee01 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.347822 Jul 01 16:43:00.651989 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 184/379] 10.222.0.57 () {60 vars in 1158 bytes} [Fri Jul 1 16:43:00 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:43:01.313347 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-355e647d-d024-48d4-96da-106e04ca0a62 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:01.314851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-355e647d-d024-48d4-96da-106e04ca0a62 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:01.323737 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-355e647d-d024-48d4-96da-106e04ca0a62 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:01.324723 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-355e647d-d024-48d4-96da-106e04ca0a62 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:01.326016 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-355e647d-d024-48d4-96da-106e04ca0a62 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:01.326882 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-dbc8ad63-bb54-43a1-87f0-b35612d0b3ed tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:01.327744 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-355e647d-d024-48d4-96da-106e04ca0a62 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:01.328071 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-dbc8ad63-bb54-43a1-87f0-b35612d0b3ed tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:01.349700 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dbc8ad63-bb54-43a1-87f0-b35612d0b3ed tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:01.350331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dbc8ad63-bb54-43a1-87f0-b35612d0b3ed tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:01.353410 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dbc8ad63-bb54-43a1-87f0-b35612d0b3ed tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:01.353881 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dbc8ad63-bb54-43a1-87f0-b35612d0b3ed tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:01.664116 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-dbc8ad63-bb54-43a1-87f0-b35612d0b3ed tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:01.680462 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-dbc8ad63-bb54-43a1-87f0-b35612d0b3ed tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1313 microversion: 2.1 time: 0.357472 Jul 01 16:43:01.693069 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 185/380] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:01 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:01.699096 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4d2da3cb-c884-44f3-ac51-3439a78dc1f0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:01.700076 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4d2da3cb-c884-44f3-ac51-3439a78dc1f0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:01.708896 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4d2da3cb-c884-44f3-ac51-3439a78dc1f0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:01.710015 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4d2da3cb-c884-44f3-ac51-3439a78dc1f0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:01.711192 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4d2da3cb-c884-44f3-ac51-3439a78dc1f0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:01.711871 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4d2da3cb-c884-44f3-ac51-3439a78dc1f0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:01.720511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-355e647d-d024-48d4-96da-106e04ca0a62 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:01.733119 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-355e647d-d024-48d4-96da-106e04ca0a62 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1369 microversion: 2.1 time: 0.424011 Jul 01 16:43:01.735248 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 196/381] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:01 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1369 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:01.746858 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-6b81b5fe-0017-44fd-93a9-2cfdd01d06a8 req-21640aee-c7a9-4d2b-9243-682671d90a51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f084bd09-4d9f-4dfc-8166-711a8c80cbee", "name": "network-vif-plugged", "status": "completed", "tag": "b1c38327-6c47-4d4f-bcc3-847a86785a63"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:43:01.757710 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-6b81b5fe-0017-44fd-93a9-2cfdd01d06a8 req-21640aee-c7a9-4d2b-9243-682671d90a51 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:01.769446 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-6b81b5fe-0017-44fd-93a9-2cfdd01d06a8 req-21640aee-c7a9-4d2b-9243-682671d90a51 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:01.815509 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-6b81b5fe-0017-44fd-93a9-2cfdd01d06a8 req-21640aee-c7a9-4d2b-9243-682671d90a51 service nova] Creating event network-vif-plugged:b1c38327-6c47-4d4f-bcc3-847a86785a63 for instance f084bd09-4d9f-4dfc-8166-711a8c80cbee on hv-cinder-79760 Jul 01 16:43:01.822368 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-6b81b5fe-0017-44fd-93a9-2cfdd01d06a8 req-21640aee-c7a9-4d2b-9243-682671d90a51 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085553 Jul 01 16:43:01.825278 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 197/382] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:43:01.930036 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4d2da3cb-c884-44f3-ac51-3439a78dc1f0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:01.940238 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4d2da3cb-c884-44f3-ac51-3439a78dc1f0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:01.941821 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4d2da3cb-c884-44f3-ac51-3439a78dc1f0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:01.943493 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4d2da3cb-c884-44f3-ac51-3439a78dc1f0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1719 microversion: 2.20 time: 0.248012 Jul 01 16:43:01.944103 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 186/383] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:01 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1719 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:02.710842 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-19efd786-a866-4535-b029-1737093a1150 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:02.712398 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-19efd786-a866-4535-b029-1737093a1150 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:02.729881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-19efd786-a866-4535-b029-1737093a1150 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:02.731827 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-19efd786-a866-4535-b029-1737093a1150 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:02.733474 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-19efd786-a866-4535-b029-1737093a1150 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:02.734361 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-19efd786-a866-4535-b029-1737093a1150 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:02.756717 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ed940707-5481-4f90-8ae3-43b3d4de1e9b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:02.757434 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ed940707-5481-4f90-8ae3-43b3d4de1e9b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:02.776492 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ed940707-5481-4f90-8ae3-43b3d4de1e9b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:02.779077 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ed940707-5481-4f90-8ae3-43b3d4de1e9b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:02.780291 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ed940707-5481-4f90-8ae3-43b3d4de1e9b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:02.791764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ed940707-5481-4f90-8ae3-43b3d4de1e9b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:03.094725 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-19efd786-a866-4535-b029-1737093a1150 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:03.102185 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-19efd786-a866-4535-b029-1737093a1150 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1313 microversion: 2.1 time: 0.404864 Jul 01 16:43:03.102802 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 198/384] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:02 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1313 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:03.107831 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5afcee47-0c88-4f2d-bb19-161f9fe6ef2d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:03.108446 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5afcee47-0c88-4f2d-bb19-161f9fe6ef2d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:03.121088 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5afcee47-0c88-4f2d-bb19-161f9fe6ef2d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:03.122058 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5afcee47-0c88-4f2d-bb19-161f9fe6ef2d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:03.124955 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5afcee47-0c88-4f2d-bb19-161f9fe6ef2d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:03.125587 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ed940707-5481-4f90-8ae3-43b3d4de1e9b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:03.125945 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5afcee47-0c88-4f2d-bb19-161f9fe6ef2d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:03.135956 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ed940707-5481-4f90-8ae3-43b3d4de1e9b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1369 microversion: 2.1 time: 0.385479 Jul 01 16:43:03.136945 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 187/385] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:02 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1369 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:03.309033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5afcee47-0c88-4f2d-bb19-161f9fe6ef2d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:03.322325 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5afcee47-0c88-4f2d-bb19-161f9fe6ef2d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:03.328250 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5afcee47-0c88-4f2d-bb19-161f9fe6ef2d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:03.330025 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5afcee47-0c88-4f2d-bb19-161f9fe6ef2d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1719 microversion: 2.20 time: 0.226223 Jul 01 16:43:03.331579 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 199/386] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:03 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1719 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:03.873420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-35784601-9c42-407d-90e5-d7721f880abe req-ba386edf-3d68-4392-8add-bc1a7540d8bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8498c0a8-d20e-4261-a0a1-d4c33004141c", "name": "network-vif-unplugged", "status": "completed", "tag": "2c1b8fc6-0b53-4c5c-83ee-2d68d226acfa"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:43:03.884007 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-35784601-9c42-407d-90e5-d7721f880abe req-ba386edf-3d68-4392-8add-bc1a7540d8bf service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:03.884476 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-35784601-9c42-407d-90e5-d7721f880abe req-ba386edf-3d68-4392-8add-bc1a7540d8bf service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:03.898828 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-35784601-9c42-407d-90e5-d7721f880abe req-ba386edf-3d68-4392-8add-bc1a7540d8bf service nova] Creating event network-vif-unplugged:2c1b8fc6-0b53-4c5c-83ee-2d68d226acfa for instance 8498c0a8-d20e-4261-a0a1-d4c33004141c on hv-cinder-79760 Jul 01 16:43:03.904014 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-35784601-9c42-407d-90e5-d7721f880abe req-ba386edf-3d68-4392-8add-bc1a7540d8bf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034947 Jul 01 16:43:03.904776 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 188/387] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:43:04.120952 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-21e93fd0-be09-4738-b1eb-13612248afe2 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:04.121562 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-21e93fd0-be09-4738-b1eb-13612248afe2 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:04.130691 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-21e93fd0-be09-4738-b1eb-13612248afe2 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:04.131398 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-21e93fd0-be09-4738-b1eb-13612248afe2 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:04.132187 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-21e93fd0-be09-4738-b1eb-13612248afe2 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:04.132618 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-21e93fd0-be09-4738-b1eb-13612248afe2 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:04.156532 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d1e5b2d8-8b8e-44d3-bd7d-1593bd926ae5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:04.157376 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d1e5b2d8-8b8e-44d3-bd7d-1593bd926ae5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:04.170759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d1e5b2d8-8b8e-44d3-bd7d-1593bd926ae5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:04.176422 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d1e5b2d8-8b8e-44d3-bd7d-1593bd926ae5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:04.177703 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d1e5b2d8-8b8e-44d3-bd7d-1593bd926ae5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:04.178393 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d1e5b2d8-8b8e-44d3-bd7d-1593bd926ae5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:04.395908 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-21e93fd0-be09-4738-b1eb-13612248afe2 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:04.405861 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d1e5b2d8-8b8e-44d3-bd7d-1593bd926ae5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:04.411958 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-21e93fd0-be09-4738-b1eb-13612248afe2 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1497 microversion: 2.1 time: 0.295372 Jul 01 16:43:04.413279 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 200/388] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:04 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1497 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:04.419881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-32f6c483-a244-4ebf-867f-e434a96d4606 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:04.421251 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-32f6c483-a244-4ebf-867f-e434a96d4606 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:04.422873 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d1e5b2d8-8b8e-44d3-bd7d-1593bd926ae5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1369 microversion: 2.1 time: 0.272689 Jul 01 16:43:04.426636 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 189/389] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:04 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1369 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:04.429385 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-32f6c483-a244-4ebf-867f-e434a96d4606 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:04.429951 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-32f6c483-a244-4ebf-867f-e434a96d4606 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:04.430885 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-32f6c483-a244-4ebf-867f-e434a96d4606 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:04.431498 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-32f6c483-a244-4ebf-867f-e434a96d4606 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:04.607436 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-32f6c483-a244-4ebf-867f-e434a96d4606 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:04.616244 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-32f6c483-a244-4ebf-867f-e434a96d4606 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:04.618039 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-32f6c483-a244-4ebf-867f-e434a96d4606 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:04.619212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-32f6c483-a244-4ebf-867f-e434a96d4606 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1662 microversion: 2.20 time: 0.204902 Jul 01 16:43:04.619766 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 201/390] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:04 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1662 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:04.636761 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-09941423-487f-408e-b589-41a5c52d4bf7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37be8928-36ed-458f-93ba-e86a735e2341"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:43:04.637798 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-09941423-487f-408e-b589-41a5c52d4bf7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:04.644378 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-09941423-487f-408e-b589-41a5c52d4bf7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:04.644816 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-09941423-487f-408e-b589-41a5c52d4bf7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:04.645565 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-09941423-487f-408e-b589-41a5c52d4bf7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:04.646002 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-09941423-487f-408e-b589-41a5c52d4bf7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:04.938323 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-09941423-487f-408e-b589-41a5c52d4bf7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "POST /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.305391 Jul 01 16:43:04.939130 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 190/391] 10.222.0.57 () {62 vars in 1363 bytes} [Fri Jul 1 16:43:04 2022] POST /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c/os-volume_attachments => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 16:43:05.057947 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-bb86560d-ec02-4d1a-b531-b92025894256 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:43:05.059104 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-bb86560d-ec02-4d1a-b531-b92025894256 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:05.066223 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bb86560d-ec02-4d1a-b531-b92025894256 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:05.066696 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bb86560d-ec02-4d1a-b531-b92025894256 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:05.067494 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bb86560d-ec02-4d1a-b531-b92025894256 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:05.067928 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bb86560d-ec02-4d1a-b531-b92025894256 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:05.160477 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-bb86560d-ec02-4d1a-b531-b92025894256 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "POST /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c/action" status: 202 len: 0 microversion: 2.20 time: 0.106788 Jul 01 16:43:05.161399 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 202/392] 10.222.0.57 () {62 vars in 1318 bytes} [Fri Jul 1 16:43:05 2022] POST /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 01 16:43:05.169095 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f5fddd89-94c1-43b3-afe6-aba57e647dde tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:05.169900 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f5fddd89-94c1-43b3-afe6-aba57e647dde tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:05.176777 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f5fddd89-94c1-43b3-afe6-aba57e647dde tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:05.177246 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f5fddd89-94c1-43b3-afe6-aba57e647dde tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:05.178005 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f5fddd89-94c1-43b3-afe6-aba57e647dde tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:05.178466 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f5fddd89-94c1-43b3-afe6-aba57e647dde tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:05.318206 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f5fddd89-94c1-43b3-afe6-aba57e647dde tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:05.329865 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f5fddd89-94c1-43b3-afe6-aba57e647dde tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:05.331414 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f5fddd89-94c1-43b3-afe6-aba57e647dde tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:05.332582 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f5fddd89-94c1-43b3-afe6-aba57e647dde tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1748 microversion: 2.20 time: 0.167430 Jul 01 16:43:05.333147 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 191/393] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:05 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:05.354696 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-07e27ba8-509d-45c6-a531-da12d1dae234 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:05.355592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-07e27ba8-509d-45c6-a531-da12d1dae234 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:05.363401 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-07e27ba8-509d-45c6-a531-da12d1dae234 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:05.363761 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-07e27ba8-509d-45c6-a531-da12d1dae234 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:05.364545 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-07e27ba8-509d-45c6-a531-da12d1dae234 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:05.365155 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-07e27ba8-509d-45c6-a531-da12d1dae234 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:05.405683 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-07e27ba8-509d-45c6-a531-da12d1dae234 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 16:43:05.444324 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ae6fbe03-733e-4f29-8535-be09ebae8a51 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:05.444934 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ae6fbe03-733e-4f29-8535-be09ebae8a51 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:05.451818 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ae6fbe03-733e-4f29-8535-be09ebae8a51 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:05.452198 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ae6fbe03-733e-4f29-8535-be09ebae8a51 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:05.464341 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ae6fbe03-733e-4f29-8535-be09ebae8a51 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:05.464808 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ae6fbe03-733e-4f29-8535-be09ebae8a51 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:05.505361 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-07e27ba8-509d-45c6-a531-da12d1dae234 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 204 len: 0 microversion: 2.1 time: 0.154787 Jul 01 16:43:05.506291 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 203/394] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:43:05 2022] DELETE /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 16:43:05.515814 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-11e52d58-3f4b-47f1-85ca-2a756f9bbc10 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:05.516893 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-11e52d58-3f4b-47f1-85ca-2a756f9bbc10 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:05.524699 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-11e52d58-3f4b-47f1-85ca-2a756f9bbc10 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:05.525811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-11e52d58-3f4b-47f1-85ca-2a756f9bbc10 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:05.527104 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-11e52d58-3f4b-47f1-85ca-2a756f9bbc10 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:05.527770 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-11e52d58-3f4b-47f1-85ca-2a756f9bbc10 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:05.739683 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ae6fbe03-733e-4f29-8535-be09ebae8a51 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:05.742521 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:43:05.757515 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ae6fbe03-733e-4f29-8535-be09ebae8a51 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1369 microversion: 2.1 time: 0.316855 Jul 01 16:43:05.758010 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 192/395] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:05 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1369 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:43:05.769724 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-11e52d58-3f4b-47f1-85ca-2a756f9bbc10 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:05.782744 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-11e52d58-3f4b-47f1-85ca-2a756f9bbc10 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1503 microversion: 2.1 time: 0.271746 Jul 01 16:43:05.783337 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 204/396] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:05 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1503 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:43:06.352670 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-aa36baac-7d19-4d4b-a186-45ebc9066144 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:06.353298 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-aa36baac-7d19-4d4b-a186-45ebc9066144 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:06.361081 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aa36baac-7d19-4d4b-a186-45ebc9066144 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:06.361529 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aa36baac-7d19-4d4b-a186-45ebc9066144 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:06.362297 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aa36baac-7d19-4d4b-a186-45ebc9066144 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:06.362762 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aa36baac-7d19-4d4b-a186-45ebc9066144 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:06.503031 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-aa36baac-7d19-4d4b-a186-45ebc9066144 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:06.511640 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-aa36baac-7d19-4d4b-a186-45ebc9066144 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:06.513195 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-aa36baac-7d19-4d4b-a186-45ebc9066144 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:06.514370 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-aa36baac-7d19-4d4b-a186-45ebc9066144 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1748 microversion: 2.20 time: 0.165684 Jul 01 16:43:06.514935 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 193/397] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:06 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1748 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:06.775811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e4085663-c888-473c-9566-585470f8f236 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:06.776371 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e4085663-c888-473c-9566-585470f8f236 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:06.779539 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:43:06.786725 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e4085663-c888-473c-9566-585470f8f236 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:06.787224 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e4085663-c888-473c-9566-585470f8f236 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:06.788043 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e4085663-c888-473c-9566-585470f8f236 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:06.788522 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e4085663-c888-473c-9566-585470f8f236 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:06.800049 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3f050f05-8fda-4c2c-be42-4c3275afb0db tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:06.800746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3f050f05-8fda-4c2c-be42-4c3275afb0db tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:06.807198 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3f050f05-8fda-4c2c-be42-4c3275afb0db tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:06.807688 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3f050f05-8fda-4c2c-be42-4c3275afb0db tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:06.808456 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3f050f05-8fda-4c2c-be42-4c3275afb0db tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:06.808887 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3f050f05-8fda-4c2c-be42-4c3275afb0db tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:07.008794 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e4085663-c888-473c-9566-585470f8f236 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:07.017008 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e4085663-c888-473c-9566-585470f8f236 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1564 microversion: 2.1 time: 0.245265 Jul 01 16:43:07.017584 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 205/398] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:06 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1564 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:07.024228 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3f050f05-8fda-4c2c-be42-4c3275afb0db tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:07.032131 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3f050f05-8fda-4c2c-be42-4c3275afb0db tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1503 microversion: 2.1 time: 0.235922 Jul 01 16:43:07.032701 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 194/399] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:06 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1503 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:07.033394 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1644c83c-f52e-4f57-8155-13b3b8818fa4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:07.034034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1644c83c-f52e-4f57-8155-13b3b8818fa4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:07.040058 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1644c83c-f52e-4f57-8155-13b3b8818fa4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:07.040704 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1644c83c-f52e-4f57-8155-13b3b8818fa4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:07.041472 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1644c83c-f52e-4f57-8155-13b3b8818fa4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:07.041904 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1644c83c-f52e-4f57-8155-13b3b8818fa4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:07.120652 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1644c83c-f52e-4f57-8155-13b3b8818fa4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091277 Jul 01 16:43:07.121260 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 206/400] 10.222.0.57 () {58 vars in 1274 bytes} [Fri Jul 1 16:43:07 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:43:07.535350 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-77aa086c-7f31-45d8-a5dd-b80a7e3f177c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:07.536070 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-77aa086c-7f31-45d8-a5dd-b80a7e3f177c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:07.543544 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-77aa086c-7f31-45d8-a5dd-b80a7e3f177c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:07.544000 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-77aa086c-7f31-45d8-a5dd-b80a7e3f177c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:07.545647 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-77aa086c-7f31-45d8-a5dd-b80a7e3f177c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:07.545961 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-77aa086c-7f31-45d8-a5dd-b80a7e3f177c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:07.799666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-77aa086c-7f31-45d8-a5dd-b80a7e3f177c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:07.809187 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-77aa086c-7f31-45d8-a5dd-b80a7e3f177c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:07.811080 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-77aa086c-7f31-45d8-a5dd-b80a7e3f177c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:07.812365 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-77aa086c-7f31-45d8-a5dd-b80a7e3f177c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1748 microversion: 2.20 time: 0.283379 Jul 01 16:43:07.813025 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 195/401] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:07 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1748 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:43:08.053023 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6f3b81b2-e0c3-4d9e-8410-a16b49d53580 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:08.054720 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6f3b81b2-e0c3-4d9e-8410-a16b49d53580 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:08.062269 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6f3b81b2-e0c3-4d9e-8410-a16b49d53580 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:08.062770 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6f3b81b2-e0c3-4d9e-8410-a16b49d53580 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:08.063748 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6f3b81b2-e0c3-4d9e-8410-a16b49d53580 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:08.064190 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6f3b81b2-e0c3-4d9e-8410-a16b49d53580 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:08.098080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:43:08.361558 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6f3b81b2-e0c3-4d9e-8410-a16b49d53580 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:08.369612 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6f3b81b2-e0c3-4d9e-8410-a16b49d53580 tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1503 microversion: 2.1 time: 0.322793 Jul 01 16:43:08.379279 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 207/402] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:08 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1503 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:08.526968 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-a6e6d956-9645-4ef1-b7c9-26fc48ddb59e req-f9fb1b8a-a39b-41bd-b136-928dc896483a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f084bd09-4d9f-4dfc-8166-711a8c80cbee", "tag": "b1c38327-6c47-4d4f-bcc3-847a86785a63"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:43:08.535942 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-a6e6d956-9645-4ef1-b7c9-26fc48ddb59e req-f9fb1b8a-a39b-41bd-b136-928dc896483a service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:08.536567 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-a6e6d956-9645-4ef1-b7c9-26fc48ddb59e req-f9fb1b8a-a39b-41bd-b136-928dc896483a service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:08.551689 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-a6e6d956-9645-4ef1-b7c9-26fc48ddb59e req-f9fb1b8a-a39b-41bd-b136-928dc896483a service nova] Creating event network-changed:b1c38327-6c47-4d4f-bcc3-847a86785a63 for instance f084bd09-4d9f-4dfc-8166-711a8c80cbee on hv-cinder-79760 Jul 01 16:43:08.558182 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-a6e6d956-9645-4ef1-b7c9-26fc48ddb59e req-f9fb1b8a-a39b-41bd-b136-928dc896483a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035650 Jul 01 16:43:08.559233 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 196/403] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:43:08.841053 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-eea1e439-0d92-466c-9e84-c4e4c33da691 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:08.842330 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-eea1e439-0d92-466c-9e84-c4e4c33da691 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:08.860358 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eea1e439-0d92-466c-9e84-c4e4c33da691 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:08.862935 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eea1e439-0d92-466c-9e84-c4e4c33da691 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:08.875530 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eea1e439-0d92-466c-9e84-c4e4c33da691 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:08.875983 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eea1e439-0d92-466c-9e84-c4e4c33da691 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:09.109740 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-eea1e439-0d92-466c-9e84-c4e4c33da691 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:09.120494 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-eea1e439-0d92-466c-9e84-c4e4c33da691 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:09.122240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-eea1e439-0d92-466c-9e84-c4e4c33da691 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:09.123995 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-eea1e439-0d92-466c-9e84-c4e4c33da691 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1750 microversion: 2.20 time: 0.295942 Jul 01 16:43:09.135922 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 208/404] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:08 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1750 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:09.178620 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-7b80ed88-51ee-4aed-9c84-a083a782d7ac req-a0946117-8cfa-483f-a67b-59c7715d45cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9ae1288-04e2-4b2e-a52a-f74e91635ebd", "name": "network-vif-deleted", "tag": "a3b0c557-db2a-4027-8b65-b4fb36645ae7"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:43:09.191409 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-7b80ed88-51ee-4aed-9c84-a083a782d7ac req-a0946117-8cfa-483f-a67b-59c7715d45cd service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:09.191858 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-7b80ed88-51ee-4aed-9c84-a083a782d7ac req-a0946117-8cfa-483f-a67b-59c7715d45cd service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:09.204518 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-7b80ed88-51ee-4aed-9c84-a083a782d7ac req-a0946117-8cfa-483f-a67b-59c7715d45cd service nova] Creating event network-vif-deleted:a3b0c557-db2a-4027-8b65-b4fb36645ae7 for instance f9ae1288-04e2-4b2e-a52a-f74e91635ebd on hv-cinder-79760 Jul 01 16:43:09.211730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-7b80ed88-51ee-4aed-9c84-a083a782d7ac req-a0946117-8cfa-483f-a67b-59c7715d45cd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039702 Jul 01 16:43:09.214724 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 197/405] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:43:09.386860 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-bfb5faec-ae19-4690-a735-db837ced242e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:09.387811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-bfb5faec-ae19-4690-a735-db837ced242e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:09.395682 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bfb5faec-ae19-4690-a735-db837ced242e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:09.396292 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bfb5faec-ae19-4690-a735-db837ced242e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:09.397196 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bfb5faec-ae19-4690-a735-db837ced242e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:09.397722 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bfb5faec-ae19-4690-a735-db837ced242e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:09.443967 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bfb5faec-ae19-4690-a735-db837ced242e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:09.444781 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bfb5faec-ae19-4690-a735-db837ced242e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:09.445528 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-bfb5faec-ae19-4690-a735-db837ced242e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lazy-loading 'fault' on Instance uuid f9ae1288-04e2-4b2e-a52a-f74e91635ebd {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:43:09.495661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-bfb5faec-ae19-4690-a735-db837ced242e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a1540974a444f8341d395d6a2b070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6598cf49d3a4426be411fa45be0c7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:09.510264 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-bfb5faec-ae19-4690-a735-db837ced242e tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 200 len: 1303 microversion: 2.1 time: 0.127100 Jul 01 16:43:09.519647 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 209/406] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:09 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 1303 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:10.143896 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a1486d0b-e3d5-4ddb-9fa3-286cf2c7a79b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:10.144505 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a1486d0b-e3d5-4ddb-9fa3-286cf2c7a79b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:10.151125 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a1486d0b-e3d5-4ddb-9fa3-286cf2c7a79b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:10.151566 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a1486d0b-e3d5-4ddb-9fa3-286cf2c7a79b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:10.152312 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a1486d0b-e3d5-4ddb-9fa3-286cf2c7a79b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:10.152737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a1486d0b-e3d5-4ddb-9fa3-286cf2c7a79b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:10.293067 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a1486d0b-e3d5-4ddb-9fa3-286cf2c7a79b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:10.303098 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a1486d0b-e3d5-4ddb-9fa3-286cf2c7a79b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:10.305765 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a1486d0b-e3d5-4ddb-9fa3-286cf2c7a79b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:10.307183 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a1486d0b-e3d5-4ddb-9fa3-286cf2c7a79b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.167829 Jul 01 16:43:10.307755 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 198/407] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:10 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:10.528288 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a2febbe0-dfb1-4f19-a009-d7a9061c530b tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:10.529326 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a2febbe0-dfb1-4f19-a009-d7a9061c530b tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] [instance: f9ae1288-04e2-4b2e-a52a-f74e91635ebd] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:10.536753 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a2febbe0-dfb1-4f19-a009-d7a9061c530b tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:10.537193 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a2febbe0-dfb1-4f19-a009-d7a9061c530b tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:10.537973 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a2febbe0-dfb1-4f19-a009-d7a9061c530b tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:10.538428 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a2febbe0-dfb1-4f19-a009-d7a9061c530b tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:10.554166 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-a2febbe0-dfb1-4f19-a009-d7a9061c530b tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] HTTP exception thrown: Instance f9ae1288-04e2-4b2e-a52a-f74e91635ebd could not be found. Jul 01 16:43:10.555836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a2febbe0-dfb1-4f19-a009-d7a9061c530b tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Request method failure captured: Jul 01 16:43:10.555836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd HTTP/1.1 Jul 01 16:43:10.555836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:43:10.555836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:43:10.555836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:43:10.555836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:43:10.555836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:43:10.555836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:43:10.555836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:43:10.555836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:43:10.555836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyPQNdtPzVBLscLHA3Cbc8jl5kGivzsVS6leoyfYS29exsafoYLvQTkHjx-qEQQtHVv1u_aKwM8x0ooUZ_iC_U-PSGj1V5efwIAvqrnULz1qM3YkNM4lWkwub5NfVs2dX_kV272IVVSFygigNQ6FTA0r3Ru0DiOCZXt5SmRSbE6hkL0 Jul 01 16:43:10.555836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:43:10.555836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:43:10.555836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:43:10.555836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:43:10.555836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:43:10.555836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:43:10.555836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: b6598cf49d3a4426be411fa45be0c7c8 Jul 01 16:43:10.555836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-VolumesActionsTest-1818344444 Jul 01 16:43:10.555836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:43:10.555836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:43:10.557369 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b6598cf49d3a4426be411fa45be0c7c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b6598cf49d3a4426be411fa45be0c7c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b6598cf49d3a4426be411fa45be0c7c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b6598cf49d3a4426be411fa45be0c7c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:43:10.557369 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-VolumesActionsTest-1818344444 Jul 01 16:43:10.557369 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: b6598cf49d3a4426be411fa45be0c7c8 Jul 01 16:43:10.557369 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-VolumesActionsTest-1818344444 Jul 01 16:43:10.557369 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-VolumesActionsTest-1818344444-project Jul 01 16:43:10.557369 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:43:10.557369 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:43:10.557369 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: 1f2a1540974a444f8341d395d6a2b070 Jul 01 16:43:10.557369 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-VolumesActionsTest-1818344444-project Jul 01 16:43:10.557369 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: > Jul 01 16:43:10.557369 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Instance f9ae1288-04e2-4b2e-a52a-f74e91635ebd could not be found. Jul 01 16:43:10.557369 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'id': 'f9ae1288-04e2-4b2e-a52a-f74e91635ebd'} Jul 01 16:43:10.558240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:43:10.558240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:43:10.558240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:43:10.558240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:43:10.558240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:43:10.558240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:43:10.558240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:43:10.558240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:43:10.558240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:43:10.558240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:43:10.558240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9ae1288-04e2-4b2e-a52a-f74e91635ebd could not be found. Jul 01 16:43:10.558240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:43:10.558240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:43:10.558240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:43:10.558240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:43:10.558240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:43:10.558240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:43:10.558240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:43:10.558240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:43:10.558240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:43:10.559564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:43:10.559564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:43:10.559564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:43:10.559564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:43:10.559564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:43:10.559564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:43:10.559564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:43:10.559564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9ae1288-04e2-4b2e-a52a-f74e91635ebd could not be found. Jul 01 16:43:10.559564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:43:10.559564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:43:10.559564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:43:10.559564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:43:10.559564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:43:10.559564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:43:10.559564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:43:10.559564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:43:10.559564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9ae1288-04e2-4b2e-a52a-f74e91635ebd could not be found. Jul 01 16:43:10.559564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:43:10.561934 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a2febbe0-dfb1-4f19-a009-d7a9061c530b tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] Returning 404 to user: Instance f9ae1288-04e2-4b2e-a52a-f74e91635ebd could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:43:10.561934 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a2febbe0-dfb1-4f19-a009-d7a9061c530b tempest-VolumesActionsTest-1818344444 tempest-VolumesActionsTest-1818344444-project] 10.222.0.57 "GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd" status: 404 len: 111 microversion: 2.1 time: 0.032947 Jul 01 16:43:10.561934 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 210/408] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:10 2022] GET /compute/v2.1/servers/f9ae1288-04e2-4b2e-a52a-f74e91635ebd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:43:11.326895 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-15552278-ee38-478e-8956-f0570fe7c02e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:11.327505 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-15552278-ee38-478e-8956-f0570fe7c02e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:11.329476 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=4 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:43:11.336001 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-15552278-ee38-478e-8956-f0570fe7c02e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:11.336453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-15552278-ee38-478e-8956-f0570fe7c02e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:11.337234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-15552278-ee38-478e-8956-f0570fe7c02e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:11.337673 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-15552278-ee38-478e-8956-f0570fe7c02e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:11.476835 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-15552278-ee38-478e-8956-f0570fe7c02e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:11.485903 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-15552278-ee38-478e-8956-f0570fe7c02e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:11.487619 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-15552278-ee38-478e-8956-f0570fe7c02e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:11.488834 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-15552278-ee38-478e-8956-f0570fe7c02e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.165904 Jul 01 16:43:11.489390 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 199/409] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:11 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:12.507088 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0615a403-6e08-4c97-a2a1-da868594143a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:12.507723 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0615a403-6e08-4c97-a2a1-da868594143a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:12.515082 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0615a403-6e08-4c97-a2a1-da868594143a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:12.515630 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0615a403-6e08-4c97-a2a1-da868594143a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:12.516398 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0615a403-6e08-4c97-a2a1-da868594143a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:12.516984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0615a403-6e08-4c97-a2a1-da868594143a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:12.654844 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0615a403-6e08-4c97-a2a1-da868594143a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:12.663122 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0615a403-6e08-4c97-a2a1-da868594143a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:12.664635 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0615a403-6e08-4c97-a2a1-da868594143a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:12.665774 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0615a403-6e08-4c97-a2a1-da868594143a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.162592 Jul 01 16:43:12.666323 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 211/410] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:12 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:13.685952 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d8233c6b-2255-467f-ba7b-3b2be3ae70e4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:13.686625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d8233c6b-2255-467f-ba7b-3b2be3ae70e4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:13.694026 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d8233c6b-2255-467f-ba7b-3b2be3ae70e4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:13.694792 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d8233c6b-2255-467f-ba7b-3b2be3ae70e4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:13.695745 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d8233c6b-2255-467f-ba7b-3b2be3ae70e4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:13.696427 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d8233c6b-2255-467f-ba7b-3b2be3ae70e4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:13.915887 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d8233c6b-2255-467f-ba7b-3b2be3ae70e4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:13.925422 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d8233c6b-2255-467f-ba7b-3b2be3ae70e4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:13.926977 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d8233c6b-2255-467f-ba7b-3b2be3ae70e4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:13.928147 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d8233c6b-2255-467f-ba7b-3b2be3ae70e4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.247250 Jul 01 16:43:13.935029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 200/411] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:13 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:43:14.946310 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3d6327b4-13f9-4735-98fe-136f3e81208e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:14.947239 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3d6327b4-13f9-4735-98fe-136f3e81208e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:14.955352 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3d6327b4-13f9-4735-98fe-136f3e81208e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:14.955851 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3d6327b4-13f9-4735-98fe-136f3e81208e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:14.956622 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3d6327b4-13f9-4735-98fe-136f3e81208e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:14.957054 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3d6327b4-13f9-4735-98fe-136f3e81208e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:15.101596 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3d6327b4-13f9-4735-98fe-136f3e81208e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:15.111302 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3d6327b4-13f9-4735-98fe-136f3e81208e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:15.112827 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3d6327b4-13f9-4735-98fe-136f3e81208e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:15.114024 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3d6327b4-13f9-4735-98fe-136f3e81208e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.172088 Jul 01 16:43:15.114628 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 212/412] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:14 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:16.134115 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b1b09309-ac04-4b33-a515-cf7680cb1576 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:16.134795 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b1b09309-ac04-4b33-a515-cf7680cb1576 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:16.141983 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b1b09309-ac04-4b33-a515-cf7680cb1576 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:16.142458 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b1b09309-ac04-4b33-a515-cf7680cb1576 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:16.143231 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b1b09309-ac04-4b33-a515-cf7680cb1576 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:16.143665 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b1b09309-ac04-4b33-a515-cf7680cb1576 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:16.274425 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b1b09309-ac04-4b33-a515-cf7680cb1576 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:16.283632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b1b09309-ac04-4b33-a515-cf7680cb1576 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:16.284988 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b1b09309-ac04-4b33-a515-cf7680cb1576 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:16.286200 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b1b09309-ac04-4b33-a515-cf7680cb1576 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.155998 Jul 01 16:43:16.286799 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 201/413] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:16 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:17.305034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c97ee15c-f0bd-4274-ab3b-a70e7ceb4a65 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:17.305653 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c97ee15c-f0bd-4274-ab3b-a70e7ceb4a65 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:17.312741 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c97ee15c-f0bd-4274-ab3b-a70e7ceb4a65 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:17.313212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c97ee15c-f0bd-4274-ab3b-a70e7ceb4a65 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:17.314040 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c97ee15c-f0bd-4274-ab3b-a70e7ceb4a65 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:17.314822 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c97ee15c-f0bd-4274-ab3b-a70e7ceb4a65 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:17.467020 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c97ee15c-f0bd-4274-ab3b-a70e7ceb4a65 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:17.476399 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c97ee15c-f0bd-4274-ab3b-a70e7ceb4a65 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:17.477913 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c97ee15c-f0bd-4274-ab3b-a70e7ceb4a65 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:17.479121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c97ee15c-f0bd-4274-ab3b-a70e7ceb4a65 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.178065 Jul 01 16:43:17.479680 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 213/414] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:17 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:18.500100 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-33e1dade-6ee6-4150-b296-b693c387dada tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:18.501145 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-33e1dade-6ee6-4150-b296-b693c387dada tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:18.507795 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-33e1dade-6ee6-4150-b296-b693c387dada tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:18.508327 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-33e1dade-6ee6-4150-b296-b693c387dada tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:18.509061 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-33e1dade-6ee6-4150-b296-b693c387dada tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:18.509499 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-33e1dade-6ee6-4150-b296-b693c387dada tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:18.706744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-33e1dade-6ee6-4150-b296-b693c387dada tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:18.720061 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-33e1dade-6ee6-4150-b296-b693c387dada tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:18.722422 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-33e1dade-6ee6-4150-b296-b693c387dada tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:18.724738 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-33e1dade-6ee6-4150-b296-b693c387dada tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.231504 Jul 01 16:43:18.725568 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 202/415] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:18 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:19.747439 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-58941962-631d-466b-8512-6a5b45011e3c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:19.748499 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-58941962-631d-466b-8512-6a5b45011e3c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:19.755953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-58941962-631d-466b-8512-6a5b45011e3c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:19.756406 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-58941962-631d-466b-8512-6a5b45011e3c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:19.757185 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-58941962-631d-466b-8512-6a5b45011e3c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:19.757626 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-58941962-631d-466b-8512-6a5b45011e3c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:19.949645 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-58941962-631d-466b-8512-6a5b45011e3c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:19.962906 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-58941962-631d-466b-8512-6a5b45011e3c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:19.964753 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-58941962-631d-466b-8512-6a5b45011e3c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:19.967934 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-58941962-631d-466b-8512-6a5b45011e3c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.226199 Jul 01 16:43:19.979069 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 214/416] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:19 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:20.991987 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-bf93e5f7-7b2a-4847-b682-635bb16718b3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:20.993449 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-bf93e5f7-7b2a-4847-b682-635bb16718b3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:21.002083 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bf93e5f7-7b2a-4847-b682-635bb16718b3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:21.003068 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bf93e5f7-7b2a-4847-b682-635bb16718b3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:21.004175 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bf93e5f7-7b2a-4847-b682-635bb16718b3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:21.004851 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bf93e5f7-7b2a-4847-b682-635bb16718b3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:21.196239 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bf93e5f7-7b2a-4847-b682-635bb16718b3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:21.211116 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bf93e5f7-7b2a-4847-b682-635bb16718b3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:21.212629 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bf93e5f7-7b2a-4847-b682-635bb16718b3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:21.213816 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-bf93e5f7-7b2a-4847-b682-635bb16718b3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.229158 Jul 01 16:43:21.225313 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 203/417] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:20 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:22.234592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b8bee237-234d-431c-bdc7-e60de87e2ee7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:22.236128 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b8bee237-234d-431c-bdc7-e60de87e2ee7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:22.244184 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b8bee237-234d-431c-bdc7-e60de87e2ee7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:22.244968 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b8bee237-234d-431c-bdc7-e60de87e2ee7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:22.246013 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b8bee237-234d-431c-bdc7-e60de87e2ee7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:22.246721 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b8bee237-234d-431c-bdc7-e60de87e2ee7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:22.421539 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b8bee237-234d-431c-bdc7-e60de87e2ee7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:22.448039 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b8bee237-234d-431c-bdc7-e60de87e2ee7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:22.450010 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b8bee237-234d-431c-bdc7-e60de87e2ee7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:22.452221 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b8bee237-234d-431c-bdc7-e60de87e2ee7 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.223307 Jul 01 16:43:22.463008 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 215/418] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:22 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:23.472446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-862fc9a1-cb9f-4202-adc5-3680ab03bec5 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:23.473380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-862fc9a1-cb9f-4202-adc5-3680ab03bec5 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:23.480453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-862fc9a1-cb9f-4202-adc5-3680ab03bec5 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:23.480908 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-862fc9a1-cb9f-4202-adc5-3680ab03bec5 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:23.481948 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-862fc9a1-cb9f-4202-adc5-3680ab03bec5 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:23.482594 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-862fc9a1-cb9f-4202-adc5-3680ab03bec5 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:23.668655 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-862fc9a1-cb9f-4202-adc5-3680ab03bec5 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:23.683433 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-862fc9a1-cb9f-4202-adc5-3680ab03bec5 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:23.685475 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-862fc9a1-cb9f-4202-adc5-3680ab03bec5 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:23.686815 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-862fc9a1-cb9f-4202-adc5-3680ab03bec5 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.218973 Jul 01 16:43:23.697418 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 204/419] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:23 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:24.705872 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a7e14c47-6b25-4eaf-ab14-5b0d08d26e71 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:24.706514 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a7e14c47-6b25-4eaf-ab14-5b0d08d26e71 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:24.735330 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a7e14c47-6b25-4eaf-ab14-5b0d08d26e71 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:24.736162 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a7e14c47-6b25-4eaf-ab14-5b0d08d26e71 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:24.736970 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a7e14c47-6b25-4eaf-ab14-5b0d08d26e71 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:24.737409 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a7e14c47-6b25-4eaf-ab14-5b0d08d26e71 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:24.944440 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a7e14c47-6b25-4eaf-ab14-5b0d08d26e71 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:24.953924 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a7e14c47-6b25-4eaf-ab14-5b0d08d26e71 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:24.956086 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a7e14c47-6b25-4eaf-ab14-5b0d08d26e71 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:24.957476 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a7e14c47-6b25-4eaf-ab14-5b0d08d26e71 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.255800 Jul 01 16:43:24.958605 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 216/420] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:24 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:25.983529 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a76754fa-7625-4296-917e-f88f9e118340 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:25.984852 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a76754fa-7625-4296-917e-f88f9e118340 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:25.992215 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a76754fa-7625-4296-917e-f88f9e118340 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:25.992998 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a76754fa-7625-4296-917e-f88f9e118340 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:25.994012 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a76754fa-7625-4296-917e-f88f9e118340 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:25.994708 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a76754fa-7625-4296-917e-f88f9e118340 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:26.187012 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a76754fa-7625-4296-917e-f88f9e118340 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:26.198155 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a76754fa-7625-4296-917e-f88f9e118340 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:26.200876 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a76754fa-7625-4296-917e-f88f9e118340 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:26.202612 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a76754fa-7625-4296-917e-f88f9e118340 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.227903 Jul 01 16:43:26.203179 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 205/421] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:25 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:27.227510 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c9f3cd3c-aa38-4d0c-9c71-2b7227a50bc4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:27.230214 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c9f3cd3c-aa38-4d0c-9c71-2b7227a50bc4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:27.239235 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c9f3cd3c-aa38-4d0c-9c71-2b7227a50bc4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:27.240744 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c9f3cd3c-aa38-4d0c-9c71-2b7227a50bc4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:27.242564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c9f3cd3c-aa38-4d0c-9c71-2b7227a50bc4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:27.243984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c9f3cd3c-aa38-4d0c-9c71-2b7227a50bc4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:27.466755 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c9f3cd3c-aa38-4d0c-9c71-2b7227a50bc4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:27.475918 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c9f3cd3c-aa38-4d0c-9c71-2b7227a50bc4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:27.477425 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c9f3cd3c-aa38-4d0c-9c71-2b7227a50bc4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:27.478769 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c9f3cd3c-aa38-4d0c-9c71-2b7227a50bc4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.258544 Jul 01 16:43:27.479829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 217/422] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:27 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:28.503517 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0c97d9ca-381d-4a3c-8508-01274f619bc4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:28.505057 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0c97d9ca-381d-4a3c-8508-01274f619bc4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:28.539621 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0c97d9ca-381d-4a3c-8508-01274f619bc4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:28.540278 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0c97d9ca-381d-4a3c-8508-01274f619bc4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:28.541290 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0c97d9ca-381d-4a3c-8508-01274f619bc4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:28.541730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0c97d9ca-381d-4a3c-8508-01274f619bc4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:28.749246 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0c97d9ca-381d-4a3c-8508-01274f619bc4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:28.763698 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0c97d9ca-381d-4a3c-8508-01274f619bc4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:28.768501 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0c97d9ca-381d-4a3c-8508-01274f619bc4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:28.770142 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0c97d9ca-381d-4a3c-8508-01274f619bc4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.273925 Jul 01 16:43:28.803910 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 206/423] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:28 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:29.813649 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-977a7349-8723-448c-b699-1ce12320907d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:29.814408 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-977a7349-8723-448c-b699-1ce12320907d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:29.822821 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-977a7349-8723-448c-b699-1ce12320907d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:29.823731 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-977a7349-8723-448c-b699-1ce12320907d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:29.824973 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-977a7349-8723-448c-b699-1ce12320907d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:29.825759 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-977a7349-8723-448c-b699-1ce12320907d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:30.025844 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-977a7349-8723-448c-b699-1ce12320907d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:30.036110 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-977a7349-8723-448c-b699-1ce12320907d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:30.038033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-977a7349-8723-448c-b699-1ce12320907d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:30.039630 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-977a7349-8723-448c-b699-1ce12320907d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.230789 Jul 01 16:43:30.055731 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 218/424] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:29 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:31.059922 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1cafaf1e-1271-4a09-8846-b95960e32c1c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:31.060530 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1cafaf1e-1271-4a09-8846-b95960e32c1c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:31.066446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:43:31.068461 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1cafaf1e-1271-4a09-8846-b95960e32c1c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:31.069144 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1cafaf1e-1271-4a09-8846-b95960e32c1c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:31.069946 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1cafaf1e-1271-4a09-8846-b95960e32c1c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:31.070388 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1cafaf1e-1271-4a09-8846-b95960e32c1c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:31.303659 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1cafaf1e-1271-4a09-8846-b95960e32c1c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:31.316007 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1cafaf1e-1271-4a09-8846-b95960e32c1c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:31.318396 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1cafaf1e-1271-4a09-8846-b95960e32c1c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:31.320478 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1cafaf1e-1271-4a09-8846-b95960e32c1c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.264439 Jul 01 16:43:31.321684 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 207/425] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:31 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:32.339627 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0fd78742-4c04-41d3-882c-60f7f6a3ac78 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:32.342195 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0fd78742-4c04-41d3-882c-60f7f6a3ac78 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:32.349245 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0fd78742-4c04-41d3-882c-60f7f6a3ac78 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:32.349721 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0fd78742-4c04-41d3-882c-60f7f6a3ac78 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:32.350527 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0fd78742-4c04-41d3-882c-60f7f6a3ac78 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:32.350980 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0fd78742-4c04-41d3-882c-60f7f6a3ac78 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:32.502594 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0fd78742-4c04-41d3-882c-60f7f6a3ac78 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:32.513686 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0fd78742-4c04-41d3-882c-60f7f6a3ac78 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:32.515354 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0fd78742-4c04-41d3-882c-60f7f6a3ac78 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:32.516779 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0fd78742-4c04-41d3-882c-60f7f6a3ac78 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.181026 Jul 01 16:43:32.517341 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 219/426] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:32 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:33.535901 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ef20e4b0-e7c5-4ee5-8fff-3555b7be6ff0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:33.536517 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ef20e4b0-e7c5-4ee5-8fff-3555b7be6ff0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:33.544762 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ef20e4b0-e7c5-4ee5-8fff-3555b7be6ff0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:33.545309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ef20e4b0-e7c5-4ee5-8fff-3555b7be6ff0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:33.546031 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ef20e4b0-e7c5-4ee5-8fff-3555b7be6ff0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:33.546511 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ef20e4b0-e7c5-4ee5-8fff-3555b7be6ff0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:33.691868 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ef20e4b0-e7c5-4ee5-8fff-3555b7be6ff0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:33.700913 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ef20e4b0-e7c5-4ee5-8fff-3555b7be6ff0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:33.702447 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ef20e4b0-e7c5-4ee5-8fff-3555b7be6ff0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:33.703600 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ef20e4b0-e7c5-4ee5-8fff-3555b7be6ff0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.171564 Jul 01 16:43:33.704159 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 208/427] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:33 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:34.160180 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e65275c1-da9e-41a5-90b7-7590518dea44 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-224744101", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1420297892", "security_groups": [{"name": "tempest-secgroup-smoke-1052777872"}], "networks": [{"uuid": "7ebc39bf-8ea5-45dd-820b-480ad076a770"}], "block_device_mapping_v2": [{"uuid": "47d024a3-19a8-4ef9-b6a7-9c3c006874dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:43:34.291138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-e65275c1-da9e-41a5-90b7-7590518dea44 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] validate_networks() for [('7ebc39bf-8ea5-45dd-820b-480ad076a770', None, None, None, None, None)] {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 16:43:34.713490 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-e65275c1-da9e-41a5-90b7-7590518dea44 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 16:43:34.714258 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-e65275c1-da9e-41a5-90b7-7590518dea44 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 16:43:34.714932 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-e65275c1-da9e-41a5-90b7-7590518dea44 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 16:43:34.715938 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-e65275c1-da9e-41a5-90b7-7590518dea44 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 16:43:34.716702 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-e65275c1-da9e-41a5-90b7-7590518dea44 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 16:43:34.722092 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-fa027dee-4cc3-4601-9a64-abf8d0c23b7d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:34.723478 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-fa027dee-4cc3-4601-9a64-abf8d0c23b7d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:34.730171 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e65275c1-da9e-41a5-90b7-7590518dea44 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:34.730990 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e65275c1-da9e-41a5-90b7-7590518dea44 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:34.731712 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fa027dee-4cc3-4601-9a64-abf8d0c23b7d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:34.731712 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fa027dee-4cc3-4601-9a64-abf8d0c23b7d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:34.731917 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e65275c1-da9e-41a5-90b7-7590518dea44 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:34.732326 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e65275c1-da9e-41a5-90b7-7590518dea44 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:34.732963 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fa027dee-4cc3-4601-9a64-abf8d0c23b7d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:34.733288 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fa027dee-4cc3-4601-9a64-abf8d0c23b7d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:34.751458 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-e65275c1-da9e-41a5-90b7-7590518dea44 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Getting quotas for project 1eb9237b6e8a4b5ca032f0664d09f28e. Resources: {'ram', 'cores', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:43:34.755640 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-e65275c1-da9e-41a5-90b7-7590518dea44 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Getting quotas for user 5b62962ac2a14ae997fb637e80129beb and project 1eb9237b6e8a4b5ca032f0664d09f28e. Resources: {'ram', 'cores', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:43:34.827132 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e65275c1-da9e-41a5-90b7-7590518dea44 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 16:43:34.829360 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e65275c1-da9e-41a5-90b7-7590518dea44 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='47d024a3-19a8-4ef9-b6a7-9c3c006874dd',volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 16:43:34.899876 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-fa027dee-4cc3-4601-9a64-abf8d0c23b7d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:34.912935 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-fa027dee-4cc3-4601-9a64-abf8d0c23b7d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:34.915261 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-fa027dee-4cc3-4601-9a64-abf8d0c23b7d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:34.916470 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-fa027dee-4cc3-4601-9a64-abf8d0c23b7d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.198612 Jul 01 16:43:34.917315 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 209/428] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:34 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:43:34.997464 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e65275c1-da9e-41a5-90b7-7590518dea44 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.841253 Jul 01 16:43:35.002809 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 220/429] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 1 16:43:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 16:43:35.007947 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-43952b4f-1e12-4117-b232-c826ae91806c tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:35.008559 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-43952b4f-1e12-4117-b232-c826ae91806c tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:35.071448 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-43952b4f-1e12-4117-b232-c826ae91806c tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:35.081038 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-43952b4f-1e12-4117-b232-c826ae91806c tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1088 microversion: 2.1 time: 0.076767 Jul 01 16:43:35.081676 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 210/430] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:35 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:35.936463 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2696b0be-37ba-4a28-9cbd-04ac3b49d746 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:35.937091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2696b0be-37ba-4a28-9cbd-04ac3b49d746 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:35.946011 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2696b0be-37ba-4a28-9cbd-04ac3b49d746 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:35.946498 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2696b0be-37ba-4a28-9cbd-04ac3b49d746 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:35.950417 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2696b0be-37ba-4a28-9cbd-04ac3b49d746 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:35.950417 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2696b0be-37ba-4a28-9cbd-04ac3b49d746 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:36.100020 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-784b502d-5df3-4c5b-82eb-e7d22db4b086 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:36.101352 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-784b502d-5df3-4c5b-82eb-e7d22db4b086 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:36.107509 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-784b502d-5df3-4c5b-82eb-e7d22db4b086 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:36.108374 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-784b502d-5df3-4c5b-82eb-e7d22db4b086 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:36.109421 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-784b502d-5df3-4c5b-82eb-e7d22db4b086 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:36.110060 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-784b502d-5df3-4c5b-82eb-e7d22db4b086 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:36.122569 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2696b0be-37ba-4a28-9cbd-04ac3b49d746 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:36.132001 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2696b0be-37ba-4a28-9cbd-04ac3b49d746 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:36.133524 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2696b0be-37ba-4a28-9cbd-04ac3b49d746 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:36.134743 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2696b0be-37ba-4a28-9cbd-04ac3b49d746 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.203087 Jul 01 16:43:36.135303 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 221/431] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:35 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:36.193634 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-784b502d-5df3-4c5b-82eb-e7d22db4b086 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:36.196371 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=100 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:43:36.204080 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-784b502d-5df3-4c5b-82eb-e7d22db4b086 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1138 microversion: 2.1 time: 0.108700 Jul 01 16:43:36.204655 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 211/432] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:36 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1138 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:43:37.154417 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-7cc1da2f-3c03-4e98-9950-9629a2bb9941 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:37.154996 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-7cc1da2f-3c03-4e98-9950-9629a2bb9941 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:37.157347 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:43:37.163544 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7cc1da2f-3c03-4e98-9950-9629a2bb9941 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:37.164085 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7cc1da2f-3c03-4e98-9950-9629a2bb9941 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:37.165243 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7cc1da2f-3c03-4e98-9950-9629a2bb9941 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:37.165648 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7cc1da2f-3c03-4e98-9950-9629a2bb9941 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:37.223796 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a686ba28-4d54-4d79-9d21-a57aaf78385f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:37.225262 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a686ba28-4d54-4d79-9d21-a57aaf78385f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:37.233852 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a686ba28-4d54-4d79-9d21-a57aaf78385f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:37.234390 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a686ba28-4d54-4d79-9d21-a57aaf78385f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:37.241008 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a686ba28-4d54-4d79-9d21-a57aaf78385f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:37.241581 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a686ba28-4d54-4d79-9d21-a57aaf78385f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:37.320591 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a686ba28-4d54-4d79-9d21-a57aaf78385f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:37.341548 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a686ba28-4d54-4d79-9d21-a57aaf78385f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1138 microversion: 2.1 time: 0.121584 Jul 01 16:43:37.342281 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 212/433] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:37 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1138 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:43:37.364514 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7cc1da2f-3c03-4e98-9950-9629a2bb9941 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:37.374067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7cc1da2f-3c03-4e98-9950-9629a2bb9941 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:37.375463 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7cc1da2f-3c03-4e98-9950-9629a2bb9941 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:37.376667 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-7cc1da2f-3c03-4e98-9950-9629a2bb9941 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.226737 Jul 01 16:43:37.377231 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 222/434] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:37 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:38.362018 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4bc657fb-eae9-41f0-b11e-7da843b152d2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:38.362767 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4bc657fb-eae9-41f0-b11e-7da843b152d2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:38.371339 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4bc657fb-eae9-41f0-b11e-7da843b152d2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:38.371800 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4bc657fb-eae9-41f0-b11e-7da843b152d2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:38.372586 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4bc657fb-eae9-41f0-b11e-7da843b152d2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:38.373029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4bc657fb-eae9-41f0-b11e-7da843b152d2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:38.396228 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-45b740e4-3544-46e8-bc99-fb0c7309a523 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:38.396995 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-45b740e4-3544-46e8-bc99-fb0c7309a523 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:38.408094 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-45b740e4-3544-46e8-bc99-fb0c7309a523 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:38.409097 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-45b740e4-3544-46e8-bc99-fb0c7309a523 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:38.409888 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-45b740e4-3544-46e8-bc99-fb0c7309a523 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:38.410332 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-45b740e4-3544-46e8-bc99-fb0c7309a523 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:38.416000 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=87 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:43:38.470378 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4bc657fb-eae9-41f0-b11e-7da843b152d2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:38.479703 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4bc657fb-eae9-41f0-b11e-7da843b152d2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1138 microversion: 2.1 time: 0.121524 Jul 01 16:43:38.480386 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 213/435] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:38 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1138 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:38.605536 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-45b740e4-3544-46e8-bc99-fb0c7309a523 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:38.618273 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-45b740e4-3544-46e8-bc99-fb0c7309a523 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:38.620258 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-45b740e4-3544-46e8-bc99-fb0c7309a523 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:38.622227 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-45b740e4-3544-46e8-bc99-fb0c7309a523 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.230349 Jul 01 16:43:38.623068 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 223/436] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:38 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:43:39.497146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0ef6ad1d-f4ac-4354-a3d9-a4994f62b9fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:39.497757 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0ef6ad1d-f4ac-4354-a3d9-a4994f62b9fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:39.505072 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0ef6ad1d-f4ac-4354-a3d9-a4994f62b9fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:39.505831 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0ef6ad1d-f4ac-4354-a3d9-a4994f62b9fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:39.506635 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0ef6ad1d-f4ac-4354-a3d9-a4994f62b9fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:39.507260 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0ef6ad1d-f4ac-4354-a3d9-a4994f62b9fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:39.575672 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0ef6ad1d-f4ac-4354-a3d9-a4994f62b9fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:39.583586 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0ef6ad1d-f4ac-4354-a3d9-a4994f62b9fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1138 microversion: 2.1 time: 0.090486 Jul 01 16:43:39.584207 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 214/437] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:39 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1138 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:39.642784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9c212df0-7e3e-49bb-bf8c-f6a4a4012810 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:39.644021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9c212df0-7e3e-49bb-bf8c-f6a4a4012810 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:39.656933 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9c212df0-7e3e-49bb-bf8c-f6a4a4012810 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:39.657421 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9c212df0-7e3e-49bb-bf8c-f6a4a4012810 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:39.658218 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9c212df0-7e3e-49bb-bf8c-f6a4a4012810 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:39.658717 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9c212df0-7e3e-49bb-bf8c-f6a4a4012810 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:39.826568 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9c212df0-7e3e-49bb-bf8c-f6a4a4012810 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:39.837392 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9c212df0-7e3e-49bb-bf8c-f6a4a4012810 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:39.839131 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9c212df0-7e3e-49bb-bf8c-f6a4a4012810 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:39.841375 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9c212df0-7e3e-49bb-bf8c-f6a4a4012810 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.203347 Jul 01 16:43:39.846935 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 224/438] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:39 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:40.601448 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ac4ea8ca-e209-48e3-889f-58b2bcdbd5cc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:40.602198 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ac4ea8ca-e209-48e3-889f-58b2bcdbd5cc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:40.612694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ac4ea8ca-e209-48e3-889f-58b2bcdbd5cc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:40.613157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ac4ea8ca-e209-48e3-889f-58b2bcdbd5cc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:40.613992 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ac4ea8ca-e209-48e3-889f-58b2bcdbd5cc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:40.614494 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ac4ea8ca-e209-48e3-889f-58b2bcdbd5cc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:40.680918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ac4ea8ca-e209-48e3-889f-58b2bcdbd5cc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:40.689342 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ac4ea8ca-e209-48e3-889f-58b2bcdbd5cc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1138 microversion: 2.1 time: 0.091645 Jul 01 16:43:40.692722 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 215/439] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:40 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1138 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:40.861974 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-22465930-ce26-4d36-9789-ac931ac1c634 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:40.862626 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-22465930-ce26-4d36-9789-ac931ac1c634 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:40.870640 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-22465930-ce26-4d36-9789-ac931ac1c634 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:40.871388 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-22465930-ce26-4d36-9789-ac931ac1c634 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:40.872400 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-22465930-ce26-4d36-9789-ac931ac1c634 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:40.873039 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-22465930-ce26-4d36-9789-ac931ac1c634 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:41.036400 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-22465930-ce26-4d36-9789-ac931ac1c634 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:41.047841 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-22465930-ce26-4d36-9789-ac931ac1c634 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:41.049415 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-22465930-ce26-4d36-9789-ac931ac1c634 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:41.050879 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-22465930-ce26-4d36-9789-ac931ac1c634 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.193098 Jul 01 16:43:41.051485 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 225/440] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:40 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:43:41.718523 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ece5eeb9-06cc-44e0-a482-a038b77795fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:41.719922 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ece5eeb9-06cc-44e0-a482-a038b77795fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:41.726671 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ece5eeb9-06cc-44e0-a482-a038b77795fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:41.727367 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ece5eeb9-06cc-44e0-a482-a038b77795fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:41.728122 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ece5eeb9-06cc-44e0-a482-a038b77795fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:41.728558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ece5eeb9-06cc-44e0-a482-a038b77795fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:41.875521 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ece5eeb9-06cc-44e0-a482-a038b77795fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:41.887897 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ece5eeb9-06cc-44e0-a482-a038b77795fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1194 microversion: 2.1 time: 0.173059 Jul 01 16:43:41.898160 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 216/441] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:41 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1194 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:42.070596 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-08915b74-f03d-4b08-99ab-6fc39ea5ad69 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:42.075716 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-08915b74-f03d-4b08-99ab-6fc39ea5ad69 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:42.082448 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-08915b74-f03d-4b08-99ab-6fc39ea5ad69 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:42.083213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-08915b74-f03d-4b08-99ab-6fc39ea5ad69 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:42.084787 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-08915b74-f03d-4b08-99ab-6fc39ea5ad69 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:42.085688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-08915b74-f03d-4b08-99ab-6fc39ea5ad69 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:42.313901 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-08915b74-f03d-4b08-99ab-6fc39ea5ad69 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:42.323213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-08915b74-f03d-4b08-99ab-6fc39ea5ad69 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:42.324743 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-08915b74-f03d-4b08-99ab-6fc39ea5ad69 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:42.326049 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-08915b74-f03d-4b08-99ab-6fc39ea5ad69 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.259976 Jul 01 16:43:42.326649 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 226/442] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:42 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:42.905721 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c0481575-cdcb-4b2b-b511-c14bdb58c286 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:42.907062 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c0481575-cdcb-4b2b-b511-c14bdb58c286 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:42.915219 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c0481575-cdcb-4b2b-b511-c14bdb58c286 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:42.915739 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c0481575-cdcb-4b2b-b511-c14bdb58c286 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:42.916588 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c0481575-cdcb-4b2b-b511-c14bdb58c286 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:42.917241 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c0481575-cdcb-4b2b-b511-c14bdb58c286 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:43.170427 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c0481575-cdcb-4b2b-b511-c14bdb58c286 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:43.180008 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c0481575-cdcb-4b2b-b511-c14bdb58c286 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1272 microversion: 2.1 time: 0.278144 Jul 01 16:43:43.180892 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 217/443] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:42 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1272 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:43.351565 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-486a6064-8f1a-4dfc-9dd9-9d99f87e5d00 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:43.354048 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-486a6064-8f1a-4dfc-9dd9-9d99f87e5d00 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:43.362656 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-486a6064-8f1a-4dfc-9dd9-9d99f87e5d00 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:43.363089 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-486a6064-8f1a-4dfc-9dd9-9d99f87e5d00 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:43.364067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-486a6064-8f1a-4dfc-9dd9-9d99f87e5d00 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:43.364666 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-486a6064-8f1a-4dfc-9dd9-9d99f87e5d00 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:43.854441 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-486a6064-8f1a-4dfc-9dd9-9d99f87e5d00 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:43.870793 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-486a6064-8f1a-4dfc-9dd9-9d99f87e5d00 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:43.873457 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-486a6064-8f1a-4dfc-9dd9-9d99f87e5d00 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:43.875468 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-486a6064-8f1a-4dfc-9dd9-9d99f87e5d00 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.534084 Jul 01 16:43:43.876584 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 227/444] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:43 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:43.964187 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-70d9a59c-173e-4156-bde8-805f4ac97d06 req-8f9752aa-dbab-4323-9981-cd073769a2fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "602a9841-5b03-4f60-b3be-7c4efe7cd9ef", "tag": "dfaabde7-2cdd-46ea-9860-694b36767f5e"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:43:43.979229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-70d9a59c-173e-4156-bde8-805f4ac97d06 req-8f9752aa-dbab-4323-9981-cd073769a2fa service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:43.980136 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-70d9a59c-173e-4156-bde8-805f4ac97d06 req-8f9752aa-dbab-4323-9981-cd073769a2fa service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:43.995294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-70d9a59c-173e-4156-bde8-805f4ac97d06 req-8f9752aa-dbab-4323-9981-cd073769a2fa service nova] Creating event network-changed:dfaabde7-2cdd-46ea-9860-694b36767f5e for instance 602a9841-5b03-4f60-b3be-7c4efe7cd9ef on hv-cinder-79760 Jul 01 16:43:44.000637 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-70d9a59c-173e-4156-bde8-805f4ac97d06 req-8f9752aa-dbab-4323-9981-cd073769a2fa service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041075 Jul 01 16:43:44.002421 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 218/445] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:43:44.198174 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-bdcc9b2b-f41b-4a6a-8fee-afd0fe7f1487 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:44.198950 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-bdcc9b2b-f41b-4a6a-8fee-afd0fe7f1487 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:44.206557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bdcc9b2b-f41b-4a6a-8fee-afd0fe7f1487 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:44.207125 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bdcc9b2b-f41b-4a6a-8fee-afd0fe7f1487 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:44.208046 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bdcc9b2b-f41b-4a6a-8fee-afd0fe7f1487 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:44.208664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bdcc9b2b-f41b-4a6a-8fee-afd0fe7f1487 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:44.428378 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-bdcc9b2b-f41b-4a6a-8fee-afd0fe7f1487 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:44.437869 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-bdcc9b2b-f41b-4a6a-8fee-afd0fe7f1487 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1260 microversion: 2.1 time: 0.243503 Jul 01 16:43:44.438580 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 228/446] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:44 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1260 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:44.894704 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1f2d0532-ac6d-4d4b-ba00-912569906b6c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:44.895437 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1f2d0532-ac6d-4d4b-ba00-912569906b6c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:44.901684 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1f2d0532-ac6d-4d4b-ba00-912569906b6c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:44.902182 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1f2d0532-ac6d-4d4b-ba00-912569906b6c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:44.903875 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1f2d0532-ac6d-4d4b-ba00-912569906b6c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:44.904132 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1f2d0532-ac6d-4d4b-ba00-912569906b6c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:45.080818 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:43:45.157723 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1f2d0532-ac6d-4d4b-ba00-912569906b6c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:45.167241 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1f2d0532-ac6d-4d4b-ba00-912569906b6c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:45.169571 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1f2d0532-ac6d-4d4b-ba00-912569906b6c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:45.171053 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1f2d0532-ac6d-4d4b-ba00-912569906b6c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.280699 Jul 01 16:43:45.172111 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 219/447] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:44 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:45.455908 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-613f3e8e-cfa9-40e4-8615-36df74c1abfe tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:45.456522 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-613f3e8e-cfa9-40e4-8615-36df74c1abfe tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:45.459100 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:43:45.460668 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=6 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:43:45.469632 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-613f3e8e-cfa9-40e4-8615-36df74c1abfe tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:45.470103 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-613f3e8e-cfa9-40e4-8615-36df74c1abfe tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:45.470993 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-613f3e8e-cfa9-40e4-8615-36df74c1abfe tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:45.477819 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-613f3e8e-cfa9-40e4-8615-36df74c1abfe tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:45.658309 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-613f3e8e-cfa9-40e4-8615-36df74c1abfe tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:45.668099 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-613f3e8e-cfa9-40e4-8615-36df74c1abfe tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1260 microversion: 2.1 time: 0.216599 Jul 01 16:43:45.668800 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 229/448] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:45 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1260 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:43:45.776898 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-becd43f0-e04e-474e-a145-7ec69fdd4e88 req-f5515b3f-5022-481f-b630-10c51ea3e97f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8498c0a8-d20e-4261-a0a1-d4c33004141c", "name": "network-vif-plugged", "status": "completed", "tag": "2c1b8fc6-0b53-4c5c-83ee-2d68d226acfa"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:43:45.789832 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-becd43f0-e04e-474e-a145-7ec69fdd4e88 req-f5515b3f-5022-481f-b630-10c51ea3e97f service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:45.790540 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-becd43f0-e04e-474e-a145-7ec69fdd4e88 req-f5515b3f-5022-481f-b630-10c51ea3e97f service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:45.806615 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-becd43f0-e04e-474e-a145-7ec69fdd4e88 req-f5515b3f-5022-481f-b630-10c51ea3e97f service nova] Creating event network-vif-plugged:2c1b8fc6-0b53-4c5c-83ee-2d68d226acfa for instance 8498c0a8-d20e-4261-a0a1-d4c33004141c on hv-cinder-79760 Jul 01 16:43:45.811835 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-becd43f0-e04e-474e-a145-7ec69fdd4e88 req-f5515b3f-5022-481f-b630-10c51ea3e97f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038962 Jul 01 16:43:45.812438 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 220/449] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:43:46.190151 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3bddea94-0af6-4a67-a2b6-f05009ffab65 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:46.190706 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3bddea94-0af6-4a67-a2b6-f05009ffab65 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:46.202127 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3bddea94-0af6-4a67-a2b6-f05009ffab65 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:46.202994 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3bddea94-0af6-4a67-a2b6-f05009ffab65 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:46.203990 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3bddea94-0af6-4a67-a2b6-f05009ffab65 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:46.204335 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3bddea94-0af6-4a67-a2b6-f05009ffab65 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:46.359636 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3bddea94-0af6-4a67-a2b6-f05009ffab65 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:46.370684 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3bddea94-0af6-4a67-a2b6-f05009ffab65 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:46.373592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3bddea94-0af6-4a67-a2b6-f05009ffab65 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:46.374813 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3bddea94-0af6-4a67-a2b6-f05009ffab65 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.188637 Jul 01 16:43:46.375697 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 230/450] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:46 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:46.685998 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e3ea3455-2494-4529-a199-19f52681d437 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:46.686723 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e3ea3455-2494-4529-a199-19f52681d437 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:46.693501 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e3ea3455-2494-4529-a199-19f52681d437 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:46.693925 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e3ea3455-2494-4529-a199-19f52681d437 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:46.694719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e3ea3455-2494-4529-a199-19f52681d437 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:46.695154 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e3ea3455-2494-4529-a199-19f52681d437 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:46.837070 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e3ea3455-2494-4529-a199-19f52681d437 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:46.845486 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e3ea3455-2494-4529-a199-19f52681d437 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1260 microversion: 2.1 time: 0.164225 Jul 01 16:43:46.846068 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 221/451] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:46 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:43:47.393592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-825041f6-538c-4372-99a7-ce747ed14716 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:47.394207 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-825041f6-538c-4372-99a7-ce747ed14716 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:47.400875 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-825041f6-538c-4372-99a7-ce747ed14716 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:47.401328 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-825041f6-538c-4372-99a7-ce747ed14716 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:47.402158 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-825041f6-538c-4372-99a7-ce747ed14716 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:47.403385 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-825041f6-538c-4372-99a7-ce747ed14716 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:47.537639 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-825041f6-538c-4372-99a7-ce747ed14716 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:47.546243 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-825041f6-538c-4372-99a7-ce747ed14716 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:47.547799 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-825041f6-538c-4372-99a7-ce747ed14716 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:47.548956 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-825041f6-538c-4372-99a7-ce747ed14716 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.159312 Jul 01 16:43:47.549520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 231/452] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:47 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:43:47.800816 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6b77843d-022b-4593-b1ad-6f18125daae7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:43:47.801757 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6b77843d-022b-4593-b1ad-6f18125daae7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:47.808249 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6b77843d-022b-4593-b1ad-6f18125daae7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:47.809326 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6b77843d-022b-4593-b1ad-6f18125daae7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:47.810109 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6b77843d-022b-4593-b1ad-6f18125daae7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:47.810584 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6b77843d-022b-4593-b1ad-6f18125daae7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:47.862283 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-bbe2b668-cda9-43c9-af25-f29d0df58bf1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:47.862941 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-bbe2b668-cda9-43c9-af25-f29d0df58bf1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:47.869345 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bbe2b668-cda9-43c9-af25-f29d0df58bf1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:47.869788 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bbe2b668-cda9-43c9-af25-f29d0df58bf1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:47.870688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bbe2b668-cda9-43c9-af25-f29d0df58bf1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:47.871766 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bbe2b668-cda9-43c9-af25-f29d0df58bf1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:47.887824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6b77843d-022b-4593-b1ad-6f18125daae7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "POST /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913/action" status: 202 len: 0 microversion: 2.1 time: 0.090660 Jul 01 16:43:47.888696 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 222/453] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 1 16:43:47 2022] POST /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:43:47.903599 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f0250292-eaa1-4b7d-91d3-ad1fad5742eb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:47.904604 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f0250292-eaa1-4b7d-91d3-ad1fad5742eb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:47.911633 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f0250292-eaa1-4b7d-91d3-ad1fad5742eb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:47.912096 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f0250292-eaa1-4b7d-91d3-ad1fad5742eb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:47.912871 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f0250292-eaa1-4b7d-91d3-ad1fad5742eb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:47.913308 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f0250292-eaa1-4b7d-91d3-ad1fad5742eb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:48.098928 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-bbe2b668-cda9-43c9-af25-f29d0df58bf1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:48.107647 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-bbe2b668-cda9-43c9-af25-f29d0df58bf1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1260 microversion: 2.1 time: 0.249177 Jul 01 16:43:48.108261 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 232/454] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:47 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:43:48.129113 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f0250292-eaa1-4b7d-91d3-ad1fad5742eb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:48.137294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f0250292-eaa1-4b7d-91d3-ad1fad5742eb tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1752 microversion: 2.1 time: 0.239180 Jul 01 16:43:48.137854 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 223/455] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:47 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1752 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:48.567758 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fd4b38bc-c301-43b2-ad70-f66ce448df03 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:48.568390 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-fd4b38bc-c301-43b2-ad70-f66ce448df03 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:48.574548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fd4b38bc-c301-43b2-ad70-f66ce448df03 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:48.575002 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fd4b38bc-c301-43b2-ad70-f66ce448df03 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:48.575772 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fd4b38bc-c301-43b2-ad70-f66ce448df03 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:48.576210 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fd4b38bc-c301-43b2-ad70-f66ce448df03 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:48.711079 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fd4b38bc-c301-43b2-ad70-f66ce448df03 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:48.720952 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fd4b38bc-c301-43b2-ad70-f66ce448df03 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:48.722472 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fd4b38bc-c301-43b2-ad70-f66ce448df03 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:48.723633 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fd4b38bc-c301-43b2-ad70-f66ce448df03 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1806 microversion: 2.20 time: 0.159882 Jul 01 16:43:48.724192 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 233/456] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:48 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:49.125080 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5e734317-9c4d-4d11-8d55-41beb2d17ed8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:49.126369 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5e734317-9c4d-4d11-8d55-41beb2d17ed8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:49.133294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5e734317-9c4d-4d11-8d55-41beb2d17ed8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:49.133744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5e734317-9c4d-4d11-8d55-41beb2d17ed8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:49.134691 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5e734317-9c4d-4d11-8d55-41beb2d17ed8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:49.135053 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5e734317-9c4d-4d11-8d55-41beb2d17ed8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:49.154613 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-db9df4dd-3484-4255-92a4-a67ea8320a5c tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:49.156433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-db9df4dd-3484-4255-92a4-a67ea8320a5c tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:49.167050 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-db9df4dd-3484-4255-92a4-a67ea8320a5c tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:49.167507 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-db9df4dd-3484-4255-92a4-a67ea8320a5c tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:49.168545 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-db9df4dd-3484-4255-92a4-a67ea8320a5c tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:49.169073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-db9df4dd-3484-4255-92a4-a67ea8320a5c tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:49.531541 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-db9df4dd-3484-4255-92a4-a67ea8320a5c tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:49.537043 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5e734317-9c4d-4d11-8d55-41beb2d17ed8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:49.548828 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5e734317-9c4d-4d11-8d55-41beb2d17ed8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1260 microversion: 2.1 time: 0.427348 Jul 01 16:43:49.549188 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-db9df4dd-3484-4255-92a4-a67ea8320a5c tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1752 microversion: 2.1 time: 0.398441 Jul 01 16:43:49.550088 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 234/457] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:49 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1752 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:43:49.553943 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 224/458] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:49 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1260 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:49.741123 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2c2801b4-a336-4161-8594-44698705d3ad tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:49.741636 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2c2801b4-a336-4161-8594-44698705d3ad tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:49.748659 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2c2801b4-a336-4161-8594-44698705d3ad tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:49.749111 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2c2801b4-a336-4161-8594-44698705d3ad tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:49.749877 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2c2801b4-a336-4161-8594-44698705d3ad tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:49.750317 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2c2801b4-a336-4161-8594-44698705d3ad tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:49.830436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3f305b42-e30f-4b68-b467-93f0f36e3ee7 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:49.841416 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3f305b42-e30f-4b68-b467-93f0f36e3ee7 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:49.847907 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3f305b42-e30f-4b68-b467-93f0f36e3ee7 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:49.848644 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3f305b42-e30f-4b68-b467-93f0f36e3ee7 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:49.849619 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3f305b42-e30f-4b68-b467-93f0f36e3ee7 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:49.850276 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3f305b42-e30f-4b68-b467-93f0f36e3ee7 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:49.876901 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3f305b42-e30f-4b68-b467-93f0f36e3ee7 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204/ips" status: 200 len: 149 microversion: 2.1 time: 0.050715 Jul 01 16:43:49.877584 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 225/459] 10.222.0.57 () {58 vars in 1247 bytes} [Fri Jul 1 16:43:49 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204/ips => generated 149 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:43:49.889583 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c2150a4c-b3bd-4a7c-b953-a9826928dcf4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c2c6456-43d7-4866-a864-6e7095de2f11"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:43:49.891854 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c2150a4c-b3bd-4a7c-b953-a9826928dcf4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:49.903240 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c2150a4c-b3bd-4a7c-b953-a9826928dcf4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:49.903683 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c2150a4c-b3bd-4a7c-b953-a9826928dcf4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:49.904466 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c2150a4c-b3bd-4a7c-b953-a9826928dcf4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:49.904899 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c2150a4c-b3bd-4a7c-b953-a9826928dcf4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:49.911494 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2c2801b4-a336-4161-8594-44698705d3ad tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:49.922204 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2c2801b4-a336-4161-8594-44698705d3ad tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:49.923742 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2c2801b4-a336-4161-8594-44698705d3ad tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:49.924923 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2c2801b4-a336-4161-8594-44698705d3ad tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1793 microversion: 2.20 time: 0.187864 Jul 01 16:43:49.925477 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 235/460] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:43:49 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1793 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:43:49.988480 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-c2150a4c-b3bd-4a7c-b953-a9826928dcf4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] HTTP exception thrown: Invalid volume: volume 0c2c6456-43d7-4866-a864-6e7095de2f11 is already attached to instances: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e Jul 01 16:43:49.990234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c2150a4c-b3bd-4a7c-b953-a9826928dcf4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Request method failure captured: Jul 01 16:43:49.990234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: POST /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204/os-volume_attachments HTTP/1.1 Jul 01 16:43:49.990234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:43:49.990234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:43:49.990234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:43:49.990234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 74 Jul 01 16:43:49.990234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:43:49.990234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:43:49.990234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:43:49.990234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:43:49.990234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyN28kRS6gk46UU5wMmPqqrbKCAlsLmUAL51tGA7XZ2wRJWF2nXTu75kTgDFZ7hA4wbbjyjFuM6MIxqsPPN7wq3gn9HT9lV3kgc_ncS5tAqdDIsXq38bqSWgq9ddXJaghqMv_F2GaWnIjXUUxQMmZS8lrawCYahe-iQxu0RYfE47KKI Jul 01 16:43:49.990234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:43:49.990234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:43:49.990234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:43:49.990234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:43:49.990234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:43:49.990234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:43:49.990234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:43:49.990234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:43:49.990234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:43:49.990234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:43:49.991758 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:43:49.991758 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:43:49.991758 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:43:49.991758 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:43:49.991758 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:43:49.991758 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:43:49.991758 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:43:49.991758 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: 7c4da21fbfa3472cac6e766a2f4799d8 Jul 01 16:43:49.991758 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:43:49.991758 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Jul 01 16:43:49.991758 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {"volumeAttachment": {"volumeId": "0c2c6456-43d7-4866-a864-6e7095de2f11"}} Jul 01 16:43:49.991758 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:43:49.992744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Invalid volume: volume 0c2c6456-43d7-4866-a864-6e7095de2f11 is already attached to instances: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e Jul 01 16:43:49.992744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'server_id': 'd475a49d-1ee9-4cb0-aaea-507155a02204', 'body': {'volumeAttachment': {'volumeId': '0c2c6456-43d7-4866-a864-6e7095de2f11'}}} Jul 01 16:43:49.992744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:43:49.992744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:43:49.992744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 01 16:43:49.992744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 01 16:43:49.992744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 16:43:49.992744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 16:43:49.992744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 01 16:43:49.992744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 16:43:49.992744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 01 16:43:49.992744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 01 16:43:49.992744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 01 16:43:49.992744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 01 16:43:49.992744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0c2c6456-43d7-4866-a864-6e7095de2f11 is already attached to instances: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e Jul 01 16:43:49.992744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:43:49.992744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:43:49.992744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:43:49.992744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:43:49.994163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:43:49.994163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:43:49.994163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:43:49.994163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:43:49.994163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:43:49.994163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:43:49.994163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 16:43:49.994163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 16:43:49.994163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 16:43:49.994163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 16:43:49.994163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 16:43:49.994163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 16:43:49.994163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 01 16:43:49.994163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 01 16:43:49.994163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0c2c6456-43d7-4866-a864-6e7095de2f11 is already attached to instances: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e Jul 01 16:43:49.994163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:43:49.994163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:43:49.994163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:43:49.994163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:43:49.994163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:43:49.995794 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:43:49.995794 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:43:49.995794 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:43:49.995794 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0c2c6456-43d7-4866-a864-6e7095de2f11 is already attached to instances: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e Jul 01 16:43:49.995794 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:43:49.995794 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c2150a4c-b3bd-4a7c-b953-a9826928dcf4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Returning 400 to user: Invalid volume: volume 0c2c6456-43d7-4866-a864-6e7095de2f11 is already attached to instances: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:43:49.995794 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c2150a4c-b3bd-4a7c-b953-a9826928dcf4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "POST /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106680 Jul 01 16:43:49.995794 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 226/461] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 1 16:43:49 2022] POST /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 16:43:50.000658 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8951a875-d106-4100-bd08-eb32b0ea8e40 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:50.001162 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8951a875-d106-4100-bd08-eb32b0ea8e40 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:50.007170 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8951a875-d106-4100-bd08-eb32b0ea8e40 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:50.007657 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8951a875-d106-4100-bd08-eb32b0ea8e40 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:50.008430 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8951a875-d106-4100-bd08-eb32b0ea8e40 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:50.008873 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8951a875-d106-4100-bd08-eb32b0ea8e40 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:50.033723 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8951a875-d106-4100-bd08-eb32b0ea8e40 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 16:43:50.111750 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8951a875-d106-4100-bd08-eb32b0ea8e40 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 204 len: 0 microversion: 2.1 time: 0.114562 Jul 01 16:43:50.112336 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 236/462] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:43:49 2022] DELETE /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 16:43:50.120425 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-27d25d2a-3b82-4add-8279-0e4a14b71f26 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:50.121027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-27d25d2a-3b82-4add-8279-0e4a14b71f26 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:50.127600 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-27d25d2a-3b82-4add-8279-0e4a14b71f26 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:50.128179 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-27d25d2a-3b82-4add-8279-0e4a14b71f26 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:50.128805 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-27d25d2a-3b82-4add-8279-0e4a14b71f26 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:50.129242 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-27d25d2a-3b82-4add-8279-0e4a14b71f26 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:50.272708 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-27d25d2a-3b82-4add-8279-0e4a14b71f26 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:50.281046 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-27d25d2a-3b82-4add-8279-0e4a14b71f26 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1680 microversion: 2.1 time: 0.164408 Jul 01 16:43:50.281768 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 227/463] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:50 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:50.566578 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-04d229d7-b452-4a01-a6b7-de5422c439f1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:50.567285 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-04d229d7-b452-4a01-a6b7-de5422c439f1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:50.570911 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e18b71f8-b03c-422f-a6a2-2f72ac7f3ae6 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:50.571529 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e18b71f8-b03c-422f-a6a2-2f72ac7f3ae6 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:50.573271 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-04d229d7-b452-4a01-a6b7-de5422c439f1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:50.573748 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-04d229d7-b452-4a01-a6b7-de5422c439f1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:50.575694 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-04d229d7-b452-4a01-a6b7-de5422c439f1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:50.576133 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-04d229d7-b452-4a01-a6b7-de5422c439f1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:50.578253 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e18b71f8-b03c-422f-a6a2-2f72ac7f3ae6 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:50.578749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e18b71f8-b03c-422f-a6a2-2f72ac7f3ae6 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:50.579513 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e18b71f8-b03c-422f-a6a2-2f72ac7f3ae6 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:50.579959 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e18b71f8-b03c-422f-a6a2-2f72ac7f3ae6 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:50.779386 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-04d229d7-b452-4a01-a6b7-de5422c439f1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:50.787080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-04d229d7-b452-4a01-a6b7-de5422c439f1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1260 microversion: 2.1 time: 0.224723 Jul 01 16:43:50.787654 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 237/464] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:50 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:50.793835 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e18b71f8-b03c-422f-a6a2-2f72ac7f3ae6 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:50.801820 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e18b71f8-b03c-422f-a6a2-2f72ac7f3ae6 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1757 microversion: 2.1 time: 0.234681 Jul 01 16:43:50.802428 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 228/465] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:50 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1757 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:43:51.298625 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-13bc7428-1fb6-4fe8-8d90-949101b359ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:51.299236 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-13bc7428-1fb6-4fe8-8d90-949101b359ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:51.305700 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13bc7428-1fb6-4fe8-8d90-949101b359ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:51.306150 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13bc7428-1fb6-4fe8-8d90-949101b359ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:51.306964 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13bc7428-1fb6-4fe8-8d90-949101b359ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:51.307413 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13bc7428-1fb6-4fe8-8d90-949101b359ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:51.313134 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:43:51.445111 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-13bc7428-1fb6-4fe8-8d90-949101b359ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:51.453267 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-13bc7428-1fb6-4fe8-8d90-949101b359ac tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1680 microversion: 2.1 time: 0.158476 Jul 01 16:43:51.453838 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 238/466] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:51 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:51.802694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ad84d49d-0f5d-4910-a8ec-103218fc78aa tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:51.803328 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ad84d49d-0f5d-4910-a8ec-103218fc78aa tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:51.809813 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ad84d49d-0f5d-4910-a8ec-103218fc78aa tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:51.810254 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ad84d49d-0f5d-4910-a8ec-103218fc78aa tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:51.811036 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ad84d49d-0f5d-4910-a8ec-103218fc78aa tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:51.811464 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ad84d49d-0f5d-4910-a8ec-103218fc78aa tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:51.814072 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:43:51.820242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2e6fad47-c80a-4c5b-b518-9188c27f1e91 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:51.820859 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2e6fad47-c80a-4c5b-b518-9188c27f1e91 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:51.828546 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2e6fad47-c80a-4c5b-b518-9188c27f1e91 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:51.829003 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2e6fad47-c80a-4c5b-b518-9188c27f1e91 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:51.829773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2e6fad47-c80a-4c5b-b518-9188c27f1e91 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:51.830212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2e6fad47-c80a-4c5b-b518-9188c27f1e91 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:52.024880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ad84d49d-0f5d-4910-a8ec-103218fc78aa tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:52.032694 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ad84d49d-0f5d-4910-a8ec-103218fc78aa tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1260 microversion: 2.1 time: 0.233716 Jul 01 16:43:52.033257 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 229/467] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:51 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1260 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:52.040591 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2e6fad47-c80a-4c5b-b518-9188c27f1e91 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:52.048708 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2e6fad47-c80a-4c5b-b518-9188c27f1e91 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1757 microversion: 2.1 time: 0.232806 Jul 01 16:43:52.049311 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 239/468] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:51 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1757 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:43:52.473626 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8fc5c275-8f42-45af-af54-2f27c5a9b6ef tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:52.474230 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8fc5c275-8f42-45af-af54-2f27c5a9b6ef tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:52.480143 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8fc5c275-8f42-45af-af54-2f27c5a9b6ef tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:52.480813 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8fc5c275-8f42-45af-af54-2f27c5a9b6ef tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:52.481503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8fc5c275-8f42-45af-af54-2f27c5a9b6ef tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:52.482009 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8fc5c275-8f42-45af-af54-2f27c5a9b6ef tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:52.631388 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8fc5c275-8f42-45af-af54-2f27c5a9b6ef tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:52.639963 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8fc5c275-8f42-45af-af54-2f27c5a9b6ef tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1680 microversion: 2.1 time: 0.171729 Jul 01 16:43:52.640560 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 230/469] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:52 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:53.049584 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-08354d46-6f60-4019-b048-49b9b6036ce5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:53.050196 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-08354d46-6f60-4019-b048-49b9b6036ce5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:53.056811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-08354d46-6f60-4019-b048-49b9b6036ce5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:53.057263 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-08354d46-6f60-4019-b048-49b9b6036ce5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:53.058030 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-08354d46-6f60-4019-b048-49b9b6036ce5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:53.058646 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-08354d46-6f60-4019-b048-49b9b6036ce5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:53.066244 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a378c413-747b-4730-97ee-baf01a56e3e9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:53.066900 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a378c413-747b-4730-97ee-baf01a56e3e9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:53.073429 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a378c413-747b-4730-97ee-baf01a56e3e9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:53.073880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a378c413-747b-4730-97ee-baf01a56e3e9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:53.075011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a378c413-747b-4730-97ee-baf01a56e3e9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:53.075446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a378c413-747b-4730-97ee-baf01a56e3e9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:53.257610 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-08354d46-6f60-4019-b048-49b9b6036ce5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:53.265762 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-08354d46-6f60-4019-b048-49b9b6036ce5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1260 microversion: 2.1 time: 0.220018 Jul 01 16:43:53.266553 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 240/470] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:53 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:53.283064 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a378c413-747b-4730-97ee-baf01a56e3e9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:53.291128 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a378c413-747b-4730-97ee-baf01a56e3e9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1757 microversion: 2.1 time: 0.228672 Jul 01 16:43:53.291768 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 231/471] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:53 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1757 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:43:53.658115 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-dc7949ab-7e5d-4833-ac97-a7e738029e5b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:53.658806 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-dc7949ab-7e5d-4833-ac97-a7e738029e5b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:53.664852 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dc7949ab-7e5d-4833-ac97-a7e738029e5b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:53.665240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dc7949ab-7e5d-4833-ac97-a7e738029e5b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:53.666008 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dc7949ab-7e5d-4833-ac97-a7e738029e5b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:53.666472 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dc7949ab-7e5d-4833-ac97-a7e738029e5b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:53.913168 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-dc7949ab-7e5d-4833-ac97-a7e738029e5b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:53.922004 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-dc7949ab-7e5d-4833-ac97-a7e738029e5b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1680 microversion: 2.1 time: 0.267627 Jul 01 16:43:53.922626 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 241/472] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:53 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1680 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:54.283930 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1ff9ab4e-b23a-40c8-a52b-421327826ee9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:54.285249 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1ff9ab4e-b23a-40c8-a52b-421327826ee9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:54.296263 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1ff9ab4e-b23a-40c8-a52b-421327826ee9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:54.296830 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1ff9ab4e-b23a-40c8-a52b-421327826ee9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:54.297754 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1ff9ab4e-b23a-40c8-a52b-421327826ee9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:54.298543 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1ff9ab4e-b23a-40c8-a52b-421327826ee9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:54.312128 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5aeb116b-3c86-4a44-a879-fb886360b884 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:54.313473 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5aeb116b-3c86-4a44-a879-fb886360b884 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:54.323075 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5aeb116b-3c86-4a44-a879-fb886360b884 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:54.325345 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5aeb116b-3c86-4a44-a879-fb886360b884 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:54.326612 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5aeb116b-3c86-4a44-a879-fb886360b884 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:54.327298 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5aeb116b-3c86-4a44-a879-fb886360b884 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:54.820263 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1ff9ab4e-b23a-40c8-a52b-421327826ee9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:54.836211 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1ff9ab4e-b23a-40c8-a52b-421327826ee9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1260 microversion: 2.1 time: 0.554690 Jul 01 16:43:54.838128 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 232/473] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:54 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1260 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:54.847135 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5aeb116b-3c86-4a44-a879-fb886360b884 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:54.857023 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5aeb116b-3c86-4a44-a879-fb886360b884 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1757 microversion: 2.1 time: 0.552905 Jul 01 16:43:54.857649 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 242/474] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:54 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1757 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:54.859666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-e178fc69-c981-43ac-8c44-8cf2ac987a88 req-22f46c02-6cbd-4eee-b6c0-2086a7f567a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d475a49d-1ee9-4cb0-aaea-507155a02204", "name": "network-vif-deleted", "tag": "b942fa2d-b73f-482d-a3fc-1e5162c3f4a5"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:43:54.876183 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-e178fc69-c981-43ac-8c44-8cf2ac987a88 req-22f46c02-6cbd-4eee-b6c0-2086a7f567a9 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:54.877392 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-e178fc69-c981-43ac-8c44-8cf2ac987a88 req-22f46c02-6cbd-4eee-b6c0-2086a7f567a9 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:54.894583 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-e178fc69-c981-43ac-8c44-8cf2ac987a88 req-22f46c02-6cbd-4eee-b6c0-2086a7f567a9 service nova] Creating event network-vif-deleted:b942fa2d-b73f-482d-a3fc-1e5162c3f4a5 for instance d475a49d-1ee9-4cb0-aaea-507155a02204 on hv-cinder-79760 Jul 01 16:43:54.903842 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-e178fc69-c981-43ac-8c44-8cf2ac987a88 req-22f46c02-6cbd-4eee-b6c0-2086a7f567a9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057992 Jul 01 16:43:54.904440 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 233/475] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:43:54.945833 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-64d0385a-b53f-42e9-9606-eff41da0fb1c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:54.947008 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-64d0385a-b53f-42e9-9606-eff41da0fb1c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:54.972114 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-64d0385a-b53f-42e9-9606-eff41da0fb1c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:54.972752 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-64d0385a-b53f-42e9-9606-eff41da0fb1c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:54.973836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-64d0385a-b53f-42e9-9606-eff41da0fb1c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:54.974655 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-64d0385a-b53f-42e9-9606-eff41da0fb1c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:55.049539 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-64d0385a-b53f-42e9-9606-eff41da0fb1c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:55.057581 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-64d0385a-b53f-42e9-9606-eff41da0fb1c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 200 len: 1326 microversion: 2.1 time: 0.119610 Jul 01 16:43:55.059468 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 243/476] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:54 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 1326 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:43:55.856640 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-ea057303-a399-4926-8f58-c87c4bdca592 req-81f8c47c-2c8f-433c-923f-67688b3d2923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "602a9841-5b03-4f60-b3be-7c4efe7cd9ef", "name": "network-vif-plugged", "status": "completed", "tag": "dfaabde7-2cdd-46ea-9860-694b36767f5e"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:43:55.861705 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fa3f293a-86ce-4515-a633-32f6e58fc39e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:55.862338 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-fa3f293a-86ce-4515-a633-32f6e58fc39e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:55.868046 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-ea057303-a399-4926-8f58-c87c4bdca592 req-81f8c47c-2c8f-433c-923f-67688b3d2923 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:55.868780 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-ea057303-a399-4926-8f58-c87c4bdca592 req-81f8c47c-2c8f-433c-923f-67688b3d2923 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:55.873595 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fa3f293a-86ce-4515-a633-32f6e58fc39e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:55.874331 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fa3f293a-86ce-4515-a633-32f6e58fc39e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:55.877219 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fa3f293a-86ce-4515-a633-32f6e58fc39e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:55.877772 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fa3f293a-86ce-4515-a633-32f6e58fc39e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:55.889943 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-ea057303-a399-4926-8f58-c87c4bdca592 req-81f8c47c-2c8f-433c-923f-67688b3d2923 service nova] Creating event network-vif-plugged:dfaabde7-2cdd-46ea-9860-694b36767f5e for instance 602a9841-5b03-4f60-b3be-7c4efe7cd9ef on hv-cinder-79760 Jul 01 16:43:55.895450 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-ea057303-a399-4926-8f58-c87c4bdca592 req-81f8c47c-2c8f-433c-923f-67688b3d2923 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044323 Jul 01 16:43:55.896367 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 234/477] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:43:55.904945 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a51ab72e-3d4e-4ad9-b74f-32a9e57fdfb3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:55.905890 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a51ab72e-3d4e-4ad9-b74f-32a9e57fdfb3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:55.919360 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a51ab72e-3d4e-4ad9-b74f-32a9e57fdfb3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:55.920058 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a51ab72e-3d4e-4ad9-b74f-32a9e57fdfb3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:55.922479 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a51ab72e-3d4e-4ad9-b74f-32a9e57fdfb3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:55.923016 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a51ab72e-3d4e-4ad9-b74f-32a9e57fdfb3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:56.153859 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a51ab72e-3d4e-4ad9-b74f-32a9e57fdfb3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:56.173159 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a51ab72e-3d4e-4ad9-b74f-32a9e57fdfb3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1757 microversion: 2.1 time: 0.275345 Jul 01 16:43:56.174011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 235/478] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:55 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1757 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:56.179368 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b998422c-37c9-4606-8ed9-67b0b9f3811a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:56.179983 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b998422c-37c9-4606-8ed9-67b0b9f3811a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:56.190498 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fa3f293a-86ce-4515-a633-32f6e58fc39e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:56.193003 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b998422c-37c9-4606-8ed9-67b0b9f3811a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:56.193772 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b998422c-37c9-4606-8ed9-67b0b9f3811a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:56.195025 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b998422c-37c9-4606-8ed9-67b0b9f3811a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:56.195630 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b998422c-37c9-4606-8ed9-67b0b9f3811a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:56.200313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fa3f293a-86ce-4515-a633-32f6e58fc39e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1260 microversion: 2.1 time: 0.342340 Jul 01 16:43:56.200914 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 244/479] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:55 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1260 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:56.215624 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-b998422c-37c9-4606-8ed9-67b0b9f3811a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] HTTP exception thrown: Instance d475a49d-1ee9-4cb0-aaea-507155a02204 could not be found. Jul 01 16:43:56.217294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b998422c-37c9-4606-8ed9-67b0b9f3811a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Request method failure captured: Jul 01 16:43:56.217294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 HTTP/1.1 Jul 01 16:43:56.217294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:43:56.217294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:43:56.217294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:43:56.217294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:43:56.217294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:43:56.217294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:43:56.217294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:43:56.217294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:43:56.217294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyN28kRS6gk46UU5wMmPqqrbKCAlsLmUAL51tGA7XZ2wRJWF2nXTu75kTgDFZ7hA4wbbjyjFuM6MIxqsPPN7wq3gn9HT9lV3kgc_ncS5tAqdDIsXq38bqSWgq9ddXJaghqMv_F2GaWnIjXUUxQMmZS8lrawCYahe-iQxu0RYfE47KKI Jul 01 16:43:56.217294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:43:56.217294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:43:56.217294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:43:56.217294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:43:56.217294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:43:56.217294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:43:56.217294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:43:56.217294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:43:56.217294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:43:56.217294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:43:56.218632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:43:56.218632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:43:56.218632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:43:56.218632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:43:56.218632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:43:56.218632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:43:56.218632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:43:56.218632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: 7c4da21fbfa3472cac6e766a2f4799d8 Jul 01 16:43:56.218632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:43:56.218632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:43:56.218632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance d475a49d-1ee9-4cb0-aaea-507155a02204 could not be found. Jul 01 16:43:56.218632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': 'd475a49d-1ee9-4cb0-aaea-507155a02204'} Jul 01 16:43:56.219468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:43:56.219468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:43:56.219468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:43:56.219468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:43:56.219468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:43:56.219468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:43:56.219468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:43:56.219468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:43:56.219468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:43:56.219468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:43:56.219468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d475a49d-1ee9-4cb0-aaea-507155a02204 could not be found. Jul 01 16:43:56.219468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:43:56.219468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:43:56.219468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:43:56.219468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:43:56.219468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:43:56.219468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:43:56.219468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:43:56.219468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:43:56.219468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:43:56.220679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:43:56.220679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:43:56.220679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:43:56.220679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:43:56.220679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:43:56.220679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:43:56.220679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:43:56.220679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d475a49d-1ee9-4cb0-aaea-507155a02204 could not be found. Jul 01 16:43:56.220679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:43:56.220679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:43:56.220679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:43:56.220679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:43:56.220679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:43:56.220679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:43:56.220679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:43:56.220679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:43:56.220679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d475a49d-1ee9-4cb0-aaea-507155a02204 could not be found. Jul 01 16:43:56.220679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:43:56.221792 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b998422c-37c9-4606-8ed9-67b0b9f3811a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Returning 404 to user: Instance d475a49d-1ee9-4cb0-aaea-507155a02204 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:43:56.221792 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b998422c-37c9-4606-8ed9-67b0b9f3811a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 404 len: 111 microversion: 2.1 time: 0.043313 Jul 01 16:43:56.221792 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 236/480] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:56 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:43:56.228344 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-45ee9d7b-0230-4170-b6bd-d9739be3d8f4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '.version_select at 0x7fa85f40aaf0>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:56.252963 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-45ee9d7b-0230-4170-b6bd-d9739be3d8f4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-920149996" status: 202 len: 0 microversion: 2.1 time: 0.028914 Jul 01 16:43:56.253883 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 245/481] 10.222.0.57 () {58 vars in 1217 bytes} [Fri Jul 1 16:43:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-920149996 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:43:56.989655 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e13ecee1-fc65-4836-b5c0-28f0a972bf1e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:56.990226 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e13ecee1-fc65-4836-b5c0-28f0a972bf1e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:56.997225 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e13ecee1-fc65-4836-b5c0-28f0a972bf1e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:56.997672 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e13ecee1-fc65-4836-b5c0-28f0a972bf1e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:56.998483 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e13ecee1-fc65-4836-b5c0-28f0a972bf1e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:56.998919 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e13ecee1-fc65-4836-b5c0-28f0a972bf1e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:57.130625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-e13ecee1-fc65-4836-b5c0-28f0a972bf1e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lazy-loading 'services' on Instance uuid bdb792a6-440e-4a96-89d8-3b65ee1a5a2e {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:43:57.191141 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5c246537-17cb-46f0-bccb-fcb9c67f66b2 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:57.191656 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5c246537-17cb-46f0-bccb-fcb9c67f66b2 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:57.198109 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5c246537-17cb-46f0-bccb-fcb9c67f66b2 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:57.199352 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5c246537-17cb-46f0-bccb-fcb9c67f66b2 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:57.200301 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5c246537-17cb-46f0-bccb-fcb9c67f66b2 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:57.200743 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5c246537-17cb-46f0-bccb-fcb9c67f66b2 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:57.257938 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e13ecee1-fc65-4836-b5c0-28f0a972bf1e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "DELETE /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e/os-volume_attachments/0c2c6456-43d7-4866-a864-6e7095de2f11" status: 202 len: 0 microversion: 2.1 time: 0.272153 Jul 01 16:43:57.263349 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 237/482] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 1 16:43:56 2022] DELETE /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e/os-volume_attachments/0c2c6456-43d7-4866-a864-6e7095de2f11 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 16:43:57.265657 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3da3a522-d1c6-4842-872e-0f20182497f2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:57.266472 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3da3a522-d1c6-4842-872e-0f20182497f2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:57.277785 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3da3a522-d1c6-4842-872e-0f20182497f2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:57.278937 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3da3a522-d1c6-4842-872e-0f20182497f2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:57.280485 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3da3a522-d1c6-4842-872e-0f20182497f2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:57.281511 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3da3a522-d1c6-4842-872e-0f20182497f2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:57.439171 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5c246537-17cb-46f0-bccb-fcb9c67f66b2 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:57.450553 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5c246537-17cb-46f0-bccb-fcb9c67f66b2 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1757 microversion: 2.1 time: 0.263700 Jul 01 16:43:57.451211 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 246/483] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:57 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1757 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:43:57.459897 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c90fd8be-8f1d-4a58-9edc-ecbac69f64d4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:57.461066 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c90fd8be-8f1d-4a58-9edc-ecbac69f64d4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:57.469145 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c90fd8be-8f1d-4a58-9edc-ecbac69f64d4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:57.469597 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c90fd8be-8f1d-4a58-9edc-ecbac69f64d4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:57.470433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c90fd8be-8f1d-4a58-9edc-ecbac69f64d4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:57.470839 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c90fd8be-8f1d-4a58-9edc-ecbac69f64d4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:57.483270 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3da3a522-d1c6-4842-872e-0f20182497f2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:57.491514 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3da3a522-d1c6-4842-872e-0f20182497f2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1260 microversion: 2.1 time: 0.230663 Jul 01 16:43:57.492835 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 238/484] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:57 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1260 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:57.508232 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c90fd8be-8f1d-4a58-9edc-ecbac69f64d4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055701 Jul 01 16:43:57.508804 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 247/485] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 1 16:43:57 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:43:58.469159 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3a2fb094-b550-42a8-b37a-4d3075bf0fc7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:58.469787 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3a2fb094-b550-42a8-b37a-4d3075bf0fc7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:58.479099 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3a2fb094-b550-42a8-b37a-4d3075bf0fc7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:58.479099 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3a2fb094-b550-42a8-b37a-4d3075bf0fc7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:58.479099 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3a2fb094-b550-42a8-b37a-4d3075bf0fc7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:58.479099 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3a2fb094-b550-42a8-b37a-4d3075bf0fc7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:58.511490 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6ea6c9ff-b6cd-456f-9d94-0c0bf7ac719f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:58.513272 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6ea6c9ff-b6cd-456f-9d94-0c0bf7ac719f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:58.521110 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6ea6c9ff-b6cd-456f-9d94-0c0bf7ac719f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:58.523860 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6ea6c9ff-b6cd-456f-9d94-0c0bf7ac719f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:58.523860 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6ea6c9ff-b6cd-456f-9d94-0c0bf7ac719f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:58.523860 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6ea6c9ff-b6cd-456f-9d94-0c0bf7ac719f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:58.704246 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3a2fb094-b550-42a8-b37a-4d3075bf0fc7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:58.713857 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3a2fb094-b550-42a8-b37a-4d3075bf0fc7 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1757 microversion: 2.1 time: 0.248963 Jul 01 16:43:58.715032 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 239/486] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:58 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1757 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:58.723060 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6ea6c9ff-b6cd-456f-9d94-0c0bf7ac719f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:58.724572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0dcc0a1c-351e-402d-a838-5b0588a0325d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:58.728953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0dcc0a1c-351e-402d-a838-5b0588a0325d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:58.732713 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6ea6c9ff-b6cd-456f-9d94-0c0bf7ac719f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1444 microversion: 2.1 time: 0.225740 Jul 01 16:43:58.733663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 248/487] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:58 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1444 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:58.745731 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0dcc0a1c-351e-402d-a838-5b0588a0325d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:58.746530 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0dcc0a1c-351e-402d-a838-5b0588a0325d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:58.747361 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0dcc0a1c-351e-402d-a838-5b0588a0325d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:58.747801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0dcc0a1c-351e-402d-a838-5b0588a0325d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:58.756450 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0d86b100-27a4-40ec-9d90-a94a4b0e2511 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:58.757071 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0d86b100-27a4-40ec-9d90-a94a4b0e2511 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:58.770958 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0d86b100-27a4-40ec-9d90-a94a4b0e2511 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:58.771883 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0d86b100-27a4-40ec-9d90-a94a4b0e2511 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:58.782152 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0d86b100-27a4-40ec-9d90-a94a4b0e2511 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:58.783063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0d86b100-27a4-40ec-9d90-a94a4b0e2511 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:58.806760 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0dcc0a1c-351e-402d-a838-5b0588a0325d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083676 Jul 01 16:43:58.807439 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 240/488] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 1 16:43:58 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:43:58.966651 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0d86b100-27a4-40ec-9d90-a94a4b0e2511 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:58.976230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0d86b100-27a4-40ec-9d90-a94a4b0e2511 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1444 microversion: 2.1 time: 0.224449 Jul 01 16:43:58.976820 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 249/489] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:58 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1444 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:43:59.731989 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-26b85658-c747-4733-b594-596a11dff880 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:59.732588 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-26b85658-c747-4733-b594-596a11dff880 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:59.739190 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-26b85658-c747-4733-b594-596a11dff880 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:59.739632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-26b85658-c747-4733-b594-596a11dff880 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:59.740398 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-26b85658-c747-4733-b594-596a11dff880 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:59.740824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-26b85658-c747-4733-b594-596a11dff880 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:59.819506 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ad09851b-0846-498f-a871-c65e9ee059a7 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:59.821061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ad09851b-0846-498f-a871-c65e9ee059a7 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:59.828999 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ad09851b-0846-498f-a871-c65e9ee059a7 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:59.829449 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ad09851b-0846-498f-a871-c65e9ee059a7 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:59.830443 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ad09851b-0846-498f-a871-c65e9ee059a7 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:59.830881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ad09851b-0846-498f-a871-c65e9ee059a7 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:59.869437 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ad09851b-0846-498f-a871-c65e9ee059a7 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054484 Jul 01 16:43:59.870005 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 250/490] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 1 16:43:59 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 01 16:43:59.899040 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-26b85658-c747-4733-b594-596a11dff880 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:43:59.909726 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-26b85658-c747-4733-b594-596a11dff880 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1757 microversion: 2.1 time: 0.181254 Jul 01 16:43:59.910862 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 241/491] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:43:59 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:43:59.941311 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cb85c091-27b2-4e03-98cc-d35af8984816 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:43:59.941808 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-cb85c091-27b2-4e03-98cc-d35af8984816 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:43:59.948379 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cb85c091-27b2-4e03-98cc-d35af8984816 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:59.949399 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cb85c091-27b2-4e03-98cc-d35af8984816 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:59.950759 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cb85c091-27b2-4e03-98cc-d35af8984816 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:43:59.951201 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cb85c091-27b2-4e03-98cc-d35af8984816 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:43:59.977645 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-cb85c091-27b2-4e03-98cc-d35af8984816 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 16:44:00.065993 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-cb85c091-27b2-4e03-98cc-d35af8984816 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "DELETE /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 204 len: 0 microversion: 2.1 time: 0.128233 Jul 01 16:44:00.067014 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 251/492] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:43:59 2022] DELETE /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 16:44:00.076432 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8e0147ba-6f03-4c06-81b9-60f7d95789e8 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:00.076964 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8e0147ba-6f03-4c06-81b9-60f7d95789e8 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:00.083465 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8e0147ba-6f03-4c06-81b9-60f7d95789e8 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:00.083911 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8e0147ba-6f03-4c06-81b9-60f7d95789e8 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:00.084953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8e0147ba-6f03-4c06-81b9-60f7d95789e8 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:00.085388 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8e0147ba-6f03-4c06-81b9-60f7d95789e8 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:00.237946 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8e0147ba-6f03-4c06-81b9-60f7d95789e8 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:00.246260 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8e0147ba-6f03-4c06-81b9-60f7d95789e8 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1683 microversion: 2.1 time: 0.174888 Jul 01 16:44:00.247686 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 242/493] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:00 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:44:00.852096 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-56d0b4f0-37d6-4f98-ab09-41be5834554e req-cfd7779a-ccb3-46e2-94ed-4e6ca3c65a1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "602a9841-5b03-4f60-b3be-7c4efe7cd9ef", "tag": "dfaabde7-2cdd-46ea-9860-694b36767f5e"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:44:00.861408 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-56d0b4f0-37d6-4f98-ab09-41be5834554e req-cfd7779a-ccb3-46e2-94ed-4e6ca3c65a1f service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:00.861847 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-56d0b4f0-37d6-4f98-ab09-41be5834554e req-cfd7779a-ccb3-46e2-94ed-4e6ca3c65a1f service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:00.874898 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-56d0b4f0-37d6-4f98-ab09-41be5834554e req-cfd7779a-ccb3-46e2-94ed-4e6ca3c65a1f service nova] Creating event network-changed:dfaabde7-2cdd-46ea-9860-694b36767f5e for instance 602a9841-5b03-4f60-b3be-7c4efe7cd9ef on hv-cinder-79760 Jul 01 16:44:00.879839 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-56d0b4f0-37d6-4f98-ab09-41be5834554e req-cfd7779a-ccb3-46e2-94ed-4e6ca3c65a1f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031835 Jul 01 16:44:00.880377 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 252/494] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:44:00.927094 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6b7488e8-a7b3-4a50-a5e2-d63751c104a3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:00.927705 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6b7488e8-a7b3-4a50-a5e2-d63751c104a3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:00.934581 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6b7488e8-a7b3-4a50-a5e2-d63751c104a3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:00.935034 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6b7488e8-a7b3-4a50-a5e2-d63751c104a3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:00.935804 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6b7488e8-a7b3-4a50-a5e2-d63751c104a3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:00.936240 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6b7488e8-a7b3-4a50-a5e2-d63751c104a3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:01.091687 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6b7488e8-a7b3-4a50-a5e2-d63751c104a3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:01.100053 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6b7488e8-a7b3-4a50-a5e2-d63751c104a3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1757 microversion: 2.1 time: 0.176722 Jul 01 16:44:01.100632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 243/495] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:00 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:01.266196 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2b453de6-dda6-4592-81d2-e7cc815043eb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:01.267040 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2b453de6-dda6-4592-81d2-e7cc815043eb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:01.273541 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2b453de6-dda6-4592-81d2-e7cc815043eb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:01.273989 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2b453de6-dda6-4592-81d2-e7cc815043eb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:01.274799 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2b453de6-dda6-4592-81d2-e7cc815043eb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:01.275240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2b453de6-dda6-4592-81d2-e7cc815043eb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:01.422745 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2b453de6-dda6-4592-81d2-e7cc815043eb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:01.430503 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2b453de6-dda6-4592-81d2-e7cc815043eb tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1683 microversion: 2.1 time: 0.169417 Jul 01 16:44:01.431078 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 253/496] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:01 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:02.117361 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1aeba471-539f-4d65-a8ce-3056c919b274 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:02.118150 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1aeba471-539f-4d65-a8ce-3056c919b274 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:02.121285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=76 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:44:02.126561 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1aeba471-539f-4d65-a8ce-3056c919b274 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:02.127008 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1aeba471-539f-4d65-a8ce-3056c919b274 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:02.127778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1aeba471-539f-4d65-a8ce-3056c919b274 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:02.128217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1aeba471-539f-4d65-a8ce-3056c919b274 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:02.273825 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1aeba471-539f-4d65-a8ce-3056c919b274 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:02.282590 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1aeba471-539f-4d65-a8ce-3056c919b274 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1757 microversion: 2.1 time: 0.169093 Jul 01 16:44:02.283155 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 244/497] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:02 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:02.448009 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-89fb7c97-6728-4a2f-8443-0b7568ccccaf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:02.449116 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-89fb7c97-6728-4a2f-8443-0b7568ccccaf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:02.455717 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-89fb7c97-6728-4a2f-8443-0b7568ccccaf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:02.456157 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-89fb7c97-6728-4a2f-8443-0b7568ccccaf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:02.456912 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-89fb7c97-6728-4a2f-8443-0b7568ccccaf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:02.457343 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-89fb7c97-6728-4a2f-8443-0b7568ccccaf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:02.587866 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-89fb7c97-6728-4a2f-8443-0b7568ccccaf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:02.590652 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:44:02.597109 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-89fb7c97-6728-4a2f-8443-0b7568ccccaf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1683 microversion: 2.1 time: 0.152987 Jul 01 16:44:02.597675 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 254/498] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:02 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:03.299531 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1f9ed9c9-8c8a-42b7-9984-208992c6be46 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:03.300130 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1f9ed9c9-8c8a-42b7-9984-208992c6be46 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:03.306591 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1f9ed9c9-8c8a-42b7-9984-208992c6be46 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:03.307034 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1f9ed9c9-8c8a-42b7-9984-208992c6be46 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:03.307878 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1f9ed9c9-8c8a-42b7-9984-208992c6be46 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:03.308312 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1f9ed9c9-8c8a-42b7-9984-208992c6be46 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:03.458717 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1f9ed9c9-8c8a-42b7-9984-208992c6be46 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:03.467509 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1f9ed9c9-8c8a-42b7-9984-208992c6be46 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1757 microversion: 2.1 time: 0.171827 Jul 01 16:44:03.468070 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 245/499] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:03 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:03.614608 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ec8378e4-ce93-40c1-a834-a19e9c67360b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:03.615152 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ec8378e4-ce93-40c1-a834-a19e9c67360b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:03.623590 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ec8378e4-ce93-40c1-a834-a19e9c67360b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:03.624169 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ec8378e4-ce93-40c1-a834-a19e9c67360b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:03.624946 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ec8378e4-ce93-40c1-a834-a19e9c67360b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:03.625421 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ec8378e4-ce93-40c1-a834-a19e9c67360b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:03.758849 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ec8378e4-ce93-40c1-a834-a19e9c67360b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:03.767225 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ec8378e4-ce93-40c1-a834-a19e9c67360b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1683 microversion: 2.1 time: 0.157490 Jul 01 16:44:03.767780 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 255/500] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:03 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:04.484510 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d73d5ffa-d394-4c88-be3a-d9a4563d7568 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:04.485139 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d73d5ffa-d394-4c88-be3a-d9a4563d7568 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:04.491693 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d73d5ffa-d394-4c88-be3a-d9a4563d7568 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:04.492134 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d73d5ffa-d394-4c88-be3a-d9a4563d7568 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:04.492890 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d73d5ffa-d394-4c88-be3a-d9a4563d7568 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:04.493316 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d73d5ffa-d394-4c88-be3a-d9a4563d7568 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:04.681117 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d73d5ffa-d394-4c88-be3a-d9a4563d7568 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:04.696457 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d73d5ffa-d394-4c88-be3a-d9a4563d7568 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1757 microversion: 2.1 time: 0.215664 Jul 01 16:44:04.697071 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 246/501] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:04 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1757 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:04.785001 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a7776ae1-bb95-40a8-8937-42afc9513f0b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:04.785789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a7776ae1-bb95-40a8-8937-42afc9513f0b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:04.793390 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a7776ae1-bb95-40a8-8937-42afc9513f0b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:04.794076 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a7776ae1-bb95-40a8-8937-42afc9513f0b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:04.795005 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a7776ae1-bb95-40a8-8937-42afc9513f0b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:04.795506 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a7776ae1-bb95-40a8-8937-42afc9513f0b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:05.030421 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a7776ae1-bb95-40a8-8937-42afc9513f0b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:05.041493 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a7776ae1-bb95-40a8-8937-42afc9513f0b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1683 microversion: 2.1 time: 0.260311 Jul 01 16:44:05.042454 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 256/502] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:04 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1683 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:05.716239 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c66b0f48-543e-43b2-8617-b77d795fd767 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:05.716854 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c66b0f48-543e-43b2-8617-b77d795fd767 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:05.722947 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c66b0f48-543e-43b2-8617-b77d795fd767 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:05.723396 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c66b0f48-543e-43b2-8617-b77d795fd767 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:05.724165 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c66b0f48-543e-43b2-8617-b77d795fd767 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:05.724634 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c66b0f48-543e-43b2-8617-b77d795fd767 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:05.728611 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:44:05.882304 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c66b0f48-543e-43b2-8617-b77d795fd767 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:05.889749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-b04e7bdf-0a7d-4e9a-9e1b-8d8a0c486df9 req-aaf679f2-3afd-41cc-8870-850a8a4c19ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb792a6-440e-4a96-89d8-3b65ee1a5a2e", "name": "network-vif-deleted", "tag": "0d85f90c-e016-4950-ba0b-5986f1ed198f"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:44:05.891739 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c66b0f48-543e-43b2-8617-b77d795fd767 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1757 microversion: 2.1 time: 0.179958 Jul 01 16:44:05.892745 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 247/503] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:05 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:05.909061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-b04e7bdf-0a7d-4e9a-9e1b-8d8a0c486df9 req-aaf679f2-3afd-41cc-8870-850a8a4c19ec service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:05.909533 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-b04e7bdf-0a7d-4e9a-9e1b-8d8a0c486df9 req-aaf679f2-3afd-41cc-8870-850a8a4c19ec service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:05.922265 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-b04e7bdf-0a7d-4e9a-9e1b-8d8a0c486df9 req-aaf679f2-3afd-41cc-8870-850a8a4c19ec service nova] Creating event network-vif-deleted:0d85f90c-e016-4950-ba0b-5986f1ed198f for instance bdb792a6-440e-4a96-89d8-3b65ee1a5a2e on hv-cinder-79760 Jul 01 16:44:05.927667 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-b04e7bdf-0a7d-4e9a-9e1b-8d8a0c486df9 req-aaf679f2-3afd-41cc-8870-850a8a4c19ec service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047401 Jul 01 16:44:05.928709 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 257/504] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:44:06.060142 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-06ef01c1-dd21-436d-be3c-93190bd1320b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:06.060764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-06ef01c1-dd21-436d-be3c-93190bd1320b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:06.067257 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-06ef01c1-dd21-436d-be3c-93190bd1320b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:06.067719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-06ef01c1-dd21-436d-be3c-93190bd1320b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:06.068621 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-06ef01c1-dd21-436d-be3c-93190bd1320b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:06.069256 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-06ef01c1-dd21-436d-be3c-93190bd1320b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:06.134720 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-06ef01c1-dd21-436d-be3c-93190bd1320b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:06.142594 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-06ef01c1-dd21-436d-be3c-93190bd1320b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1615 microversion: 2.1 time: 0.087157 Jul 01 16:44:06.143183 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 248/505] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:06 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1615 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:06.909515 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4cd4aa36-1ee7-461a-9f9c-c2a6f5e56424 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:06.910221 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4cd4aa36-1ee7-461a-9f9c-c2a6f5e56424 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:06.916988 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4cd4aa36-1ee7-461a-9f9c-c2a6f5e56424 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:06.917450 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4cd4aa36-1ee7-461a-9f9c-c2a6f5e56424 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:06.918460 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4cd4aa36-1ee7-461a-9f9c-c2a6f5e56424 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:06.918907 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4cd4aa36-1ee7-461a-9f9c-c2a6f5e56424 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:07.064005 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4cd4aa36-1ee7-461a-9f9c-c2a6f5e56424 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:07.073155 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4cd4aa36-1ee7-461a-9f9c-c2a6f5e56424 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1757 microversion: 2.1 time: 0.167840 Jul 01 16:44:07.074308 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 258/506] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:06 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:07.160005 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b06ee838-91c6-4532-bb97-1d797d8379b7 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:07.160614 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b06ee838-91c6-4532-bb97-1d797d8379b7 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:07.167200 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b06ee838-91c6-4532-bb97-1d797d8379b7 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:07.167623 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b06ee838-91c6-4532-bb97-1d797d8379b7 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:07.168819 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b06ee838-91c6-4532-bb97-1d797d8379b7 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:07.169473 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b06ee838-91c6-4532-bb97-1d797d8379b7 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:07.231605 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b06ee838-91c6-4532-bb97-1d797d8379b7 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:07.239076 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b06ee838-91c6-4532-bb97-1d797d8379b7 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1615 microversion: 2.1 time: 0.082886 Jul 01 16:44:07.239636 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 249/507] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:07 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1615 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:07.559598 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-543b94a1-9e4d-459e-a5c7-57862f1491d8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f09a1698-2666-417c-82e7-43313dfb3252"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:44:07.560665 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-543b94a1-9e4d-459e-a5c7-57862f1491d8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:07.562699 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:44:07.568029 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-543b94a1-9e4d-459e-a5c7-57862f1491d8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:07.568484 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-543b94a1-9e4d-459e-a5c7-57862f1491d8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:07.569253 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-543b94a1-9e4d-459e-a5c7-57862f1491d8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:07.569693 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-543b94a1-9e4d-459e-a5c7-57862f1491d8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:08.091761 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-cfc02143-ac12-4d21-8b66-53ead6db265b tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:08.092375 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-cfc02143-ac12-4d21-8b66-53ead6db265b tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:08.098689 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cfc02143-ac12-4d21-8b66-53ead6db265b tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:08.099143 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cfc02143-ac12-4d21-8b66-53ead6db265b tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:08.099916 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cfc02143-ac12-4d21-8b66-53ead6db265b tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:08.100351 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cfc02143-ac12-4d21-8b66-53ead6db265b tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:08.249231 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-cfc02143-ac12-4d21-8b66-53ead6db265b tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:08.257255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-cfc02143-ac12-4d21-8b66-53ead6db265b tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1757 microversion: 2.1 time: 0.170061 Jul 01 16:44:08.257830 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 250/508] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:08 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:44:08.262677 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d22d9a81-1253-4eb6-90ef-063733affa2b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:08.263270 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d22d9a81-1253-4eb6-90ef-063733affa2b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:08.268878 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d22d9a81-1253-4eb6-90ef-063733affa2b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:08.269319 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d22d9a81-1253-4eb6-90ef-063733affa2b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:08.270070 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d22d9a81-1253-4eb6-90ef-063733affa2b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:08.270529 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d22d9a81-1253-4eb6-90ef-063733affa2b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:08.332627 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d22d9a81-1253-4eb6-90ef-063733affa2b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:08.341180 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d22d9a81-1253-4eb6-90ef-063733affa2b tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1326 microversion: 2.1 time: 0.082406 Jul 01 16:44:08.341759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 251/509] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:08 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1326 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:09.274763 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5c0d3eb9-5800-4be9-8ccc-d1d9766c2c91 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:09.275648 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5c0d3eb9-5800-4be9-8ccc-d1d9766c2c91 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:09.283400 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5c0d3eb9-5800-4be9-8ccc-d1d9766c2c91 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:09.283921 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5c0d3eb9-5800-4be9-8ccc-d1d9766c2c91 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:09.284700 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5c0d3eb9-5800-4be9-8ccc-d1d9766c2c91 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:09.285282 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5c0d3eb9-5800-4be9-8ccc-d1d9766c2c91 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:09.347488 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-543b94a1-9e4d-459e-a5c7-57862f1491d8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "POST /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.792542 Jul 01 16:44:09.353744 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 259/510] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 1 16:44:07 2022] POST /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee/os-volume_attachments => generated 194 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:44:09.358163 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8fb31e69-e727-4aa5-aabe-363ba72696d3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:09.358915 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8fb31e69-e727-4aa5-aabe-363ba72696d3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:09.365362 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8fb31e69-e727-4aa5-aabe-363ba72696d3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:09.365661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8fb31e69-e727-4aa5-aabe-363ba72696d3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:09.366587 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8fb31e69-e727-4aa5-aabe-363ba72696d3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:09.367023 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8fb31e69-e727-4aa5-aabe-363ba72696d3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:09.419293 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8fb31e69-e727-4aa5-aabe-363ba72696d3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:09.419805 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8fb31e69-e727-4aa5-aabe-363ba72696d3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:09.420272 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-8fb31e69-e727-4aa5-aabe-363ba72696d3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lazy-loading 'fault' on Instance uuid bdb792a6-440e-4a96-89d8-3b65ee1a5a2e {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:44:09.476205 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8fb31e69-e727-4aa5-aabe-363ba72696d3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:09.484758 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8fb31e69-e727-4aa5-aabe-363ba72696d3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 200 len: 1331 microversion: 2.1 time: 0.131254 Jul 01 16:44:09.485347 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 260/511] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:09 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 1331 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:44:09.491539 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5c0d3eb9-5800-4be9-8ccc-d1d9766c2c91 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:09.500251 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5c0d3eb9-5800-4be9-8ccc-d1d9766c2c91 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1760 microversion: 2.1 time: 0.229234 Jul 01 16:44:09.500823 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 252/512] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:09 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1760 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:44:10.502081 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a9b56ce7-d176-4bcf-9ee8-e3bd9abce372 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:10.502683 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a9b56ce7-d176-4bcf-9ee8-e3bd9abce372 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:10.509798 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a9b56ce7-d176-4bcf-9ee8-e3bd9abce372 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:10.510473 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a9b56ce7-d176-4bcf-9ee8-e3bd9abce372 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:10.512370 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a9b56ce7-d176-4bcf-9ee8-e3bd9abce372 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:10.512819 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a9b56ce7-d176-4bcf-9ee8-e3bd9abce372 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:10.528944 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-a9b56ce7-d176-4bcf-9ee8-e3bd9abce372 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] HTTP exception thrown: Instance bdb792a6-440e-4a96-89d8-3b65ee1a5a2e could not be found. Jul 01 16:44:10.530714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a9b56ce7-d176-4bcf-9ee8-e3bd9abce372 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Request method failure captured: Jul 01 16:44:10.530714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e HTTP/1.1 Jul 01 16:44:10.530714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:44:10.530714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:44:10.530714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:44:10.530714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:44:10.530714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:44:10.530714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:44:10.530714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:44:10.530714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:44:10.530714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyN28kRS6gk46UU5wMmPqqrbKCAlsLmUAL51tGA7XZ2wRJWF2nXTu75kTgDFZ7hA4wbbjyjFuM6MIxqsPPN7wq3gn9HT9lV3kgc_ncS5tAqdDIsXq38bqSWgq9ddXJaghqMv_F2GaWnIjXUUxQMmZS8lrawCYahe-iQxu0RYfE47KKI Jul 01 16:44:10.530714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:44:10.530714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:44:10.530714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:44:10.530714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:44:10.530714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:44:10.530714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:44:10.530714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:44:10.530714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:44:10.530714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:44:10.530714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:44:10.532442 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:44:10.532442 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:44:10.532442 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:44:10.532442 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:44:10.532442 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:44:10.532442 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:44:10.532442 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:44:10.532442 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: 7c4da21fbfa3472cac6e766a2f4799d8 Jul 01 16:44:10.532442 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:44:10.532442 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: > Jul 01 16:44:10.532442 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Instance bdb792a6-440e-4a96-89d8-3b65ee1a5a2e could not be found. Jul 01 16:44:10.532442 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'id': 'bdb792a6-440e-4a96-89d8-3b65ee1a5a2e'} Jul 01 16:44:10.533253 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:44:10.533253 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:44:10.533253 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:44:10.533253 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:44:10.533253 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:44:10.533253 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:44:10.533253 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:44:10.533253 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:44:10.533253 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:44:10.533253 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:44:10.533253 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdb792a6-440e-4a96-89d8-3b65ee1a5a2e could not be found. Jul 01 16:44:10.533253 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:44:10.533253 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:44:10.533253 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:44:10.533253 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:44:10.533253 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:44:10.533253 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:44:10.533253 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:44:10.533253 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:44:10.533253 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:44:10.534741 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:44:10.534741 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:44:10.534741 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:44:10.534741 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:44:10.534741 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:44:10.534741 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:44:10.534741 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:44:10.534741 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdb792a6-440e-4a96-89d8-3b65ee1a5a2e could not be found. Jul 01 16:44:10.534741 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:44:10.534741 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:44:10.534741 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:44:10.534741 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:44:10.534741 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:44:10.534741 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:44:10.534741 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:44:10.534741 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:44:10.534741 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdb792a6-440e-4a96-89d8-3b65ee1a5a2e could not be found. Jul 01 16:44:10.534741 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:44:10.536344 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a9b56ce7-d176-4bcf-9ee8-e3bd9abce372 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Returning 404 to user: Instance bdb792a6-440e-4a96-89d8-3b65ee1a5a2e could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:44:10.536344 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a9b56ce7-d176-4bcf-9ee8-e3bd9abce372 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 404 len: 111 microversion: 2.1 time: 0.034196 Jul 01 16:44:10.536344 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 261/513] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:10 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:44:10.541296 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d71b4ba0-d35a-41ca-8873-2557cfa62a04 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '.version_select at 0x7fa86c3ff790>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:10.563957 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d71b4ba0-d35a-41ca-8873-2557cfa62a04 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-981105985" status: 202 len: 0 microversion: 2.1 time: 0.026516 Jul 01 16:44:10.564527 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 253/514] 10.222.0.57 () {58 vars in 1217 bytes} [Fri Jul 1 16:44:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-981105985 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:44:11.208734 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-857123aa-2a55-4555-9948-1a15af29dcf0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Action: 'create', calling method: .version_select at 0x7fa85f3beca0>, body: {"keypair": {"name": "tempest-keypair-2048210868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9xzWYCuI1CuCkplKy7uUwkVSUcu2wILwfYv6EuuNIo/5GyuhXLtIgcYTFLhPi7kJwVvOrsM41XbT0Ys/+G/13nsZjyHZkFtPluC+tO8otys4Cgv9Ttf2evoOmYffWt3g=="}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:44:11.224378 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-857123aa-2a55-4555-9948-1a15af29dcf0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Getting quotas for project 5747a83d930f4075a78e9b14abd58c7f. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:44:11.228255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-857123aa-2a55-4555-9948-1a15af29dcf0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Getting quotas for user 7c4da21fbfa3472cac6e766a2f4799d8 and project 5747a83d930f4075a78e9b14abd58c7f. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:44:11.249845 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-857123aa-2a55-4555-9948-1a15af29dcf0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045032 Jul 01 16:44:11.250529 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 262/515] 10.222.0.57 () {60 vars in 1158 bytes} [Fri Jul 1 16:44:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:44:12.571719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-49b5da9c-c5b4-4a46-b0b0-83d07bcc44f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-919947007", "imageRef": "42a4b1a9-dea6-4c87-a2c1-328b9c0c8558", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c5acd85f-f778-4915-8079-a3e9582e6528"}], "security_groups": [{"name": "tempest-securitygroup--614482275"}], "key_name": "tempest-keypair-2048210868", "user_data": "}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:44:12.676914 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.network.neutron [None req-49b5da9c-c5b4-4a46-b0b0-83d07bcc44f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] validate_networks() for [('c5acd85f-f778-4915-8079-a3e9582e6528', None, None, None, None, None)] {{(pid=124317) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 16:44:13.059732 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-49b5da9c-c5b4-4a46-b0b0-83d07bcc44f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Flavor limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 16:44:13.060152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-49b5da9c-c5b4-4a46-b0b0-83d07bcc44f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Image limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 16:44:13.060677 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-49b5da9c-c5b4-4a46-b0b0-83d07bcc44f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Flavor pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 16:44:13.061104 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-49b5da9c-c5b4-4a46-b0b0-83d07bcc44f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Image pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 16:44:13.061507 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-49b5da9c-c5b4-4a46-b0b0-83d07bcc44f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 16:44:13.070161 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-49b5da9c-c5b4-4a46-b0b0-83d07bcc44f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:13.070642 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-49b5da9c-c5b4-4a46-b0b0-83d07bcc44f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:13.071422 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-49b5da9c-c5b4-4a46-b0b0-83d07bcc44f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:13.071851 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-49b5da9c-c5b4-4a46-b0b0-83d07bcc44f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:13.088768 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-49b5da9c-c5b4-4a46-b0b0-83d07bcc44f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Getting quotas for project 5747a83d930f4075a78e9b14abd58c7f. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:44:13.092638 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-49b5da9c-c5b4-4a46-b0b0-83d07bcc44f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Getting quotas for user 7c4da21fbfa3472cac6e766a2f4799d8 and project 5747a83d930f4075a78e9b14abd58c7f. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:44:13.103327 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-49b5da9c-c5b4-4a46-b0b0-83d07bcc44f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Going to run 1 instances... {{(pid=124317) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 16:44:13.105898 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-49b5da9c-c5b4-4a46-b0b0-83d07bcc44f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42a4b1a9-dea6-4c87-a2c1-328b9c0c8558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124317) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 16:44:13.151725 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-49b5da9c-c5b4-4a46-b0b0-83d07bcc44f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.583620 Jul 01 16:44:13.152509 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 254/516] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 1 16:44:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 16:44:13.162096 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d89b7446-9a19-4155-9cb0-962b81ba1098 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:13.162750 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d89b7446-9a19-4155-9cb0-962b81ba1098 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:13.220937 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d89b7446-9a19-4155-9cb0-962b81ba1098 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:13.227672 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d89b7446-9a19-4155-9cb0-962b81ba1098 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 200 len: 1241 microversion: 2.1 time: 0.069462 Jul 01 16:44:13.228427 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 263/517] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:13 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:14.248269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-50b947a5-1f34-4875-b325-dc863643249e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:14.249026 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-50b947a5-1f34-4875-b325-dc863643249e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:14.256181 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-50b947a5-1f34-4875-b325-dc863643249e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:14.256641 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-50b947a5-1f34-4875-b325-dc863643249e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:14.257402 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-50b947a5-1f34-4875-b325-dc863643249e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:14.257835 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-50b947a5-1f34-4875-b325-dc863643249e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:14.327904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-50b947a5-1f34-4875-b325-dc863643249e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:14.336274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-50b947a5-1f34-4875-b325-dc863643249e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 200 len: 1301 microversion: 2.1 time: 0.094165 Jul 01 16:44:14.345776 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 255/518] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:14 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 1301 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:15.353078 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-84de12b8-9473-4772-b76e-9a1506816992 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:15.353865 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-84de12b8-9473-4772-b76e-9a1506816992 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:15.361921 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-84de12b8-9473-4772-b76e-9a1506816992 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:15.362679 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-84de12b8-9473-4772-b76e-9a1506816992 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:15.363485 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-84de12b8-9473-4772-b76e-9a1506816992 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:15.363910 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-84de12b8-9473-4772-b76e-9a1506816992 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:15.502701 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-84de12b8-9473-4772-b76e-9a1506816992 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:15.512598 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-84de12b8-9473-4772-b76e-9a1506816992 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 200 len: 1366 microversion: 2.1 time: 0.163378 Jul 01 16:44:15.513193 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 264/519] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:15 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:15.950499 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-d9b2097a-6ca8-4307-a22d-2bfffa5c12b2 req-03370541-597c-4d11-83b0-19e90be324c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d", "tag": "3048ed1f-ed3c-4ece-8895-278d40e90955"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:44:15.959046 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-d9b2097a-6ca8-4307-a22d-2bfffa5c12b2 req-03370541-597c-4d11-83b0-19e90be324c5 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:15.959745 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-d9b2097a-6ca8-4307-a22d-2bfffa5c12b2 req-03370541-597c-4d11-83b0-19e90be324c5 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:15.971980 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-d9b2097a-6ca8-4307-a22d-2bfffa5c12b2 req-03370541-597c-4d11-83b0-19e90be324c5 service nova] Creating event network-changed:3048ed1f-ed3c-4ece-8895-278d40e90955 for instance 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d on hv-cinder-79760 Jul 01 16:44:15.977047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-d9b2097a-6ca8-4307-a22d-2bfffa5c12b2 req-03370541-597c-4d11-83b0-19e90be324c5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031463 Jul 01 16:44:15.977972 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 256/520] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:44:16.529088 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-7be669ee-edf3-4e33-9a7b-9c08a52bcc06 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:16.529711 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-7be669ee-edf3-4e33-9a7b-9c08a52bcc06 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:16.536362 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7be669ee-edf3-4e33-9a7b-9c08a52bcc06 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:16.536813 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7be669ee-edf3-4e33-9a7b-9c08a52bcc06 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:16.537576 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7be669ee-edf3-4e33-9a7b-9c08a52bcc06 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:16.538014 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7be669ee-edf3-4e33-9a7b-9c08a52bcc06 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:16.677218 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7be669ee-edf3-4e33-9a7b-9c08a52bcc06 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:16.685335 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-7be669ee-edf3-4e33-9a7b-9c08a52bcc06 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 200 len: 1366 microversion: 2.1 time: 0.160211 Jul 01 16:44:16.685885 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 265/521] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:16 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:17.703276 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2ca84e93-f899-4904-8917-eb37662706c0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:17.703959 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2ca84e93-f899-4904-8917-eb37662706c0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:17.710323 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2ca84e93-f899-4904-8917-eb37662706c0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:17.710802 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2ca84e93-f899-4904-8917-eb37662706c0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:17.711562 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2ca84e93-f899-4904-8917-eb37662706c0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:17.711999 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2ca84e93-f899-4904-8917-eb37662706c0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:17.845075 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2ca84e93-f899-4904-8917-eb37662706c0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:17.853391 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2ca84e93-f899-4904-8917-eb37662706c0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 200 len: 1366 microversion: 2.1 time: 0.155419 Jul 01 16:44:17.854488 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 257/522] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:17 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:18.870866 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d9a05307-c28c-4542-a361-3daa0dae4c47 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:18.871481 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d9a05307-c28c-4542-a361-3daa0dae4c47 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:18.878116 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d9a05307-c28c-4542-a361-3daa0dae4c47 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:18.878638 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d9a05307-c28c-4542-a361-3daa0dae4c47 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:18.879423 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d9a05307-c28c-4542-a361-3daa0dae4c47 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:18.879861 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d9a05307-c28c-4542-a361-3daa0dae4c47 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:19.013768 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d9a05307-c28c-4542-a361-3daa0dae4c47 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:19.021234 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d9a05307-c28c-4542-a361-3daa0dae4c47 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 200 len: 1366 microversion: 2.1 time: 0.154489 Jul 01 16:44:19.021804 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 266/523] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:18 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:20.037879 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2011a4e5-119e-433d-b8f9-14c2d60ece5f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:20.038532 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2011a4e5-119e-433d-b8f9-14c2d60ece5f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:20.045137 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2011a4e5-119e-433d-b8f9-14c2d60ece5f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:20.045588 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2011a4e5-119e-433d-b8f9-14c2d60ece5f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:20.046367 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2011a4e5-119e-433d-b8f9-14c2d60ece5f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:20.046822 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2011a4e5-119e-433d-b8f9-14c2d60ece5f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:20.179772 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2011a4e5-119e-433d-b8f9-14c2d60ece5f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:20.188028 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2011a4e5-119e-433d-b8f9-14c2d60ece5f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 200 len: 1366 microversion: 2.1 time: 0.153970 Jul 01 16:44:20.188602 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 258/524] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:20 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:21.205132 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3e2bfa09-7561-45a9-a530-0ce1e9a90cc4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:21.205652 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3e2bfa09-7561-45a9-a530-0ce1e9a90cc4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:21.212433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3e2bfa09-7561-45a9-a530-0ce1e9a90cc4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:21.212888 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3e2bfa09-7561-45a9-a530-0ce1e9a90cc4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:21.214400 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3e2bfa09-7561-45a9-a530-0ce1e9a90cc4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:21.215031 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3e2bfa09-7561-45a9-a530-0ce1e9a90cc4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:21.349201 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3e2bfa09-7561-45a9-a530-0ce1e9a90cc4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:21.357789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3e2bfa09-7561-45a9-a530-0ce1e9a90cc4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 200 len: 1366 microversion: 2.1 time: 0.156611 Jul 01 16:44:21.358419 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 267/525] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:21 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:22.375323 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a4e2145d-b8cb-4574-8a3f-584d4e89276f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:22.375921 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a4e2145d-b8cb-4574-8a3f-584d4e89276f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:22.387614 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a4e2145d-b8cb-4574-8a3f-584d4e89276f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:22.388323 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a4e2145d-b8cb-4574-8a3f-584d4e89276f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:22.389298 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a4e2145d-b8cb-4574-8a3f-584d4e89276f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:22.390671 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a4e2145d-b8cb-4574-8a3f-584d4e89276f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:22.539717 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a4e2145d-b8cb-4574-8a3f-584d4e89276f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:22.548382 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a4e2145d-b8cb-4574-8a3f-584d4e89276f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 200 len: 1366 microversion: 2.1 time: 0.176689 Jul 01 16:44:22.548960 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 259/526] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:22 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:23.222008 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4f33ba26-651a-4f2d-96fb-a0f14e8de712 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:44:23.223057 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4f33ba26-651a-4f2d-96fb-a0f14e8de712 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:23.225452 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=6 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:44:23.231574 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4f33ba26-651a-4f2d-96fb-a0f14e8de712 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:23.232021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4f33ba26-651a-4f2d-96fb-a0f14e8de712 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:23.232785 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4f33ba26-651a-4f2d-96fb-a0f14e8de712 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:23.233220 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4f33ba26-651a-4f2d-96fb-a0f14e8de712 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:23.257190 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-4f33ba26-651a-4f2d-96fb-a0f14e8de712 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lazy-loading 'flavor' on Instance uuid f084bd09-4d9f-4dfc-8166-711a8c80cbee {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:44:23.392871 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4f33ba26-651a-4f2d-96fb-a0f14e8de712 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "POST /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee/action" status: 200 len: 32 microversion: 2.1 time: 0.174808 Jul 01 16:44:23.393561 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 268/527] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 1 16:44:23 2022] POST /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 16:44:23.404284 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-51f04e90-1ce9-4d31-b36f-8b4219cc95aa tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:23.405026 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-51f04e90-1ce9-4d31-b36f-8b4219cc95aa tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:23.410788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:44:23.411619 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=6 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:44:23.414324 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-51f04e90-1ce9-4d31-b36f-8b4219cc95aa tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:23.415034 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-51f04e90-1ce9-4d31-b36f-8b4219cc95aa tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:23.416279 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-51f04e90-1ce9-4d31-b36f-8b4219cc95aa tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:23.417935 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-51f04e90-1ce9-4d31-b36f-8b4219cc95aa tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:23.556055 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-51f04e90-1ce9-4d31-b36f-8b4219cc95aa tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:23.565414 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-51f04e90-1ce9-4d31-b36f-8b4219cc95aa tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1734 microversion: 2.1 time: 0.166564 Jul 01 16:44:23.565579 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-82dea403-f082-4626-beb7-9f5a659ca507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:23.576126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 260/528] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:23 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:23.576284 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-82dea403-f082-4626-beb7-9f5a659ca507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:23.576284 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-82dea403-f082-4626-beb7-9f5a659ca507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:23.576284 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-82dea403-f082-4626-beb7-9f5a659ca507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:23.576284 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-82dea403-f082-4626-beb7-9f5a659ca507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:23.576656 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-82dea403-f082-4626-beb7-9f5a659ca507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:23.729771 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-82dea403-f082-4626-beb7-9f5a659ca507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:23.737365 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-82dea403-f082-4626-beb7-9f5a659ca507 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 200 len: 1366 microversion: 2.1 time: 0.176058 Jul 01 16:44:23.737943 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 269/529] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:23 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:24.583806 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-37c9435c-2d53-400c-88dc-dfbe948bafd4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:24.584677 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-37c9435c-2d53-400c-88dc-dfbe948bafd4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:24.592227 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-37c9435c-2d53-400c-88dc-dfbe948bafd4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:24.592674 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-37c9435c-2d53-400c-88dc-dfbe948bafd4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:24.593446 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-37c9435c-2d53-400c-88dc-dfbe948bafd4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:24.593872 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-37c9435c-2d53-400c-88dc-dfbe948bafd4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:24.729265 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-37c9435c-2d53-400c-88dc-dfbe948bafd4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:24.737198 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-37c9435c-2d53-400c-88dc-dfbe948bafd4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1734 microversion: 2.1 time: 0.157194 Jul 01 16:44:24.737766 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 261/530] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:24 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:24.754393 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-23ae10ab-f98b-40e0-8be0-7def46830629 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:24.754959 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-23ae10ab-f98b-40e0-8be0-7def46830629 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:24.762259 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-23ae10ab-f98b-40e0-8be0-7def46830629 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:24.762856 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-23ae10ab-f98b-40e0-8be0-7def46830629 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:24.763620 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-23ae10ab-f98b-40e0-8be0-7def46830629 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:24.764059 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-23ae10ab-f98b-40e0-8be0-7def46830629 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:24.896313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-23ae10ab-f98b-40e0-8be0-7def46830629 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:24.904706 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-23ae10ab-f98b-40e0-8be0-7def46830629 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 200 len: 1366 microversion: 2.1 time: 0.154214 Jul 01 16:44:24.905267 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 270/531] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:24 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:25.756498 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7bc1d7ed-74fe-4278-a2dd-292716cafaa5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:25.757110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7bc1d7ed-74fe-4278-a2dd-292716cafaa5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:25.763727 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7bc1d7ed-74fe-4278-a2dd-292716cafaa5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:25.764177 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7bc1d7ed-74fe-4278-a2dd-292716cafaa5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:25.764935 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7bc1d7ed-74fe-4278-a2dd-292716cafaa5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:25.765368 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7bc1d7ed-74fe-4278-a2dd-292716cafaa5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:25.896167 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7bc1d7ed-74fe-4278-a2dd-292716cafaa5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:25.904632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7bc1d7ed-74fe-4278-a2dd-292716cafaa5 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1734 microversion: 2.1 time: 0.151959 Jul 01 16:44:25.905221 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 262/532] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:25 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:25.921672 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-51aeb109-eef2-4865-b3cd-0e9146931471 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:25.922280 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-51aeb109-eef2-4865-b3cd-0e9146931471 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:25.928802 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-51aeb109-eef2-4865-b3cd-0e9146931471 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:25.929251 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-51aeb109-eef2-4865-b3cd-0e9146931471 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:25.930009 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-51aeb109-eef2-4865-b3cd-0e9146931471 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:25.930479 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-51aeb109-eef2-4865-b3cd-0e9146931471 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:25.935126 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:44:26.062160 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-51aeb109-eef2-4865-b3cd-0e9146931471 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:26.069554 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-51aeb109-eef2-4865-b3cd-0e9146931471 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 200 len: 1366 microversion: 2.1 time: 0.152505 Jul 01 16:44:26.070123 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 271/533] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:25 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:26.921114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-697b003a-2167-4a55-b52e-6b20006b7c22 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:26.921723 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-697b003a-2167-4a55-b52e-6b20006b7c22 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:26.929985 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-697b003a-2167-4a55-b52e-6b20006b7c22 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:26.930473 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-697b003a-2167-4a55-b52e-6b20006b7c22 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:26.931255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-697b003a-2167-4a55-b52e-6b20006b7c22 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:26.932533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-697b003a-2167-4a55-b52e-6b20006b7c22 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:27.069449 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-697b003a-2167-4a55-b52e-6b20006b7c22 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:27.077947 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-697b003a-2167-4a55-b52e-6b20006b7c22 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1734 microversion: 2.1 time: 0.160689 Jul 01 16:44:27.078736 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 263/534] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:26 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:27.086689 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5a3d4b85-1fbe-4479-88c8-5b96da35f067 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:27.087468 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5a3d4b85-1fbe-4479-88c8-5b96da35f067 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:27.095561 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5a3d4b85-1fbe-4479-88c8-5b96da35f067 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:27.096010 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5a3d4b85-1fbe-4479-88c8-5b96da35f067 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:27.096776 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5a3d4b85-1fbe-4479-88c8-5b96da35f067 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:27.097210 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5a3d4b85-1fbe-4479-88c8-5b96da35f067 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:27.299164 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5a3d4b85-1fbe-4479-88c8-5b96da35f067 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:27.307535 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5a3d4b85-1fbe-4479-88c8-5b96da35f067 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 200 len: 1366 microversion: 2.1 time: 0.224514 Jul 01 16:44:27.308647 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 272/535] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:27 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:27.461816 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-15488415-255a-458f-a744-face7f4291bc req-b04da721-8d11-40e4-9b44-2164e122ca1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d", "name": "network-vif-plugged", "status": "completed", "tag": "3048ed1f-ed3c-4ece-8895-278d40e90955"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:44:27.471039 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-15488415-255a-458f-a744-face7f4291bc req-b04da721-8d11-40e4-9b44-2164e122ca1f service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:27.471526 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-15488415-255a-458f-a744-face7f4291bc req-b04da721-8d11-40e4-9b44-2164e122ca1f service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:27.484358 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-15488415-255a-458f-a744-face7f4291bc req-b04da721-8d11-40e4-9b44-2164e122ca1f service nova] Creating event network-vif-plugged:3048ed1f-ed3c-4ece-8895-278d40e90955 for instance 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d on hv-cinder-79760 Jul 01 16:44:27.489777 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-15488415-255a-458f-a744-face7f4291bc req-b04da721-8d11-40e4-9b44-2164e122ca1f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032132 Jul 01 16:44:27.490736 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 264/536] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:44:28.095005 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fc2dc399-9e92-46ef-8d74-d9154c132096 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:28.095608 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-fc2dc399-9e92-46ef-8d74-d9154c132096 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:28.102110 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fc2dc399-9e92-46ef-8d74-d9154c132096 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:28.102590 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fc2dc399-9e92-46ef-8d74-d9154c132096 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:28.103352 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fc2dc399-9e92-46ef-8d74-d9154c132096 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:28.104406 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fc2dc399-9e92-46ef-8d74-d9154c132096 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:28.231818 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fc2dc399-9e92-46ef-8d74-d9154c132096 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:28.239716 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fc2dc399-9e92-46ef-8d74-d9154c132096 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1734 microversion: 2.1 time: 0.148522 Jul 01 16:44:28.240280 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 273/537] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:28 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:28.325864 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4232122f-e533-427e-85a5-c0a585810fb4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:28.326622 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4232122f-e533-427e-85a5-c0a585810fb4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:28.333029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4232122f-e533-427e-85a5-c0a585810fb4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:28.333468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4232122f-e533-427e-85a5-c0a585810fb4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:28.334525 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4232122f-e533-427e-85a5-c0a585810fb4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:28.334966 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4232122f-e533-427e-85a5-c0a585810fb4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:28.473005 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4232122f-e533-427e-85a5-c0a585810fb4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:28.481337 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4232122f-e533-427e-85a5-c0a585810fb4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 200 len: 1366 microversion: 2.1 time: 0.160813 Jul 01 16:44:28.481901 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 265/538] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:28 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:29.257248 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9ac31241-4e21-4c30-bc95-4ff2ae25221d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:29.257859 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9ac31241-4e21-4c30-bc95-4ff2ae25221d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:29.265434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ac31241-4e21-4c30-bc95-4ff2ae25221d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:29.265885 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ac31241-4e21-4c30-bc95-4ff2ae25221d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:29.266789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ac31241-4e21-4c30-bc95-4ff2ae25221d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:29.267234 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ac31241-4e21-4c30-bc95-4ff2ae25221d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:29.395660 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9ac31241-4e21-4c30-bc95-4ff2ae25221d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:29.404409 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9ac31241-4e21-4c30-bc95-4ff2ae25221d tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1734 microversion: 2.1 time: 0.151060 Jul 01 16:44:29.404984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 274/539] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:29 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:29.501914 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2ea5691d-8bb1-4443-89f0-dbf654d9b244 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:29.502673 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2ea5691d-8bb1-4443-89f0-dbf654d9b244 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:29.510379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2ea5691d-8bb1-4443-89f0-dbf654d9b244 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:29.510893 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2ea5691d-8bb1-4443-89f0-dbf654d9b244 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:29.511763 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2ea5691d-8bb1-4443-89f0-dbf654d9b244 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:29.512237 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2ea5691d-8bb1-4443-89f0-dbf654d9b244 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:29.652662 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2ea5691d-8bb1-4443-89f0-dbf654d9b244 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:29.656670 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=100 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:44:29.665908 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2ea5691d-8bb1-4443-89f0-dbf654d9b244 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 200 len: 1366 microversion: 2.1 time: 0.168838 Jul 01 16:44:29.666742 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 266/540] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:29 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:30.421777 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-22c01cf9-f877-4ba4-a0bc-f0ba0b25957e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:30.422339 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-22c01cf9-f877-4ba4-a0bc-f0ba0b25957e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:30.428794 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-22c01cf9-f877-4ba4-a0bc-f0ba0b25957e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:30.429233 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-22c01cf9-f877-4ba4-a0bc-f0ba0b25957e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:30.429979 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-22c01cf9-f877-4ba4-a0bc-f0ba0b25957e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:30.430438 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-22c01cf9-f877-4ba4-a0bc-f0ba0b25957e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:30.684113 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c44ce9ea-5b33-4b20-86e5-71a003360ef0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:30.684715 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c44ce9ea-5b33-4b20-86e5-71a003360ef0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:30.691319 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c44ce9ea-5b33-4b20-86e5-71a003360ef0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:30.691764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c44ce9ea-5b33-4b20-86e5-71a003360ef0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:30.692520 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c44ce9ea-5b33-4b20-86e5-71a003360ef0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:30.692956 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c44ce9ea-5b33-4b20-86e5-71a003360ef0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:30.883436 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-22c01cf9-f877-4ba4-a0bc-f0ba0b25957e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:30.891992 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-22c01cf9-f877-4ba4-a0bc-f0ba0b25957e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1734 microversion: 2.1 time: 0.474058 Jul 01 16:44:30.892579 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 275/541] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:30 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1734 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:30.897698 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c44ce9ea-5b33-4b20-86e5-71a003360ef0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:30.905839 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c44ce9ea-5b33-4b20-86e5-71a003360ef0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 200 len: 1556 microversion: 2.1 time: 0.226024 Jul 01 16:44:30.906448 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 267/542] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:30 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 1556 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:44:30.921871 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0c14da9d-0aae-45c4-a9e3-be14682909f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:30.922377 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0c14da9d-0aae-45c4-a9e3-be14682909f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:30.928245 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0c14da9d-0aae-45c4-a9e3-be14682909f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:30.928692 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0c14da9d-0aae-45c4-a9e3-be14682909f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:30.929451 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0c14da9d-0aae-45c4-a9e3-be14682909f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:30.929879 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0c14da9d-0aae-45c4-a9e3-be14682909f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:31.009479 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0c14da9d-0aae-45c4-a9e3-be14682909f9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091444 Jul 01 16:44:31.010487 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 276/543] 10.222.0.57 () {58 vars in 1274 bytes} [Fri Jul 1 16:44:30 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:44:31.912943 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a6d89bc1-6b67-4c13-80c7-bd4370cf61a8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:31.913559 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a6d89bc1-6b67-4c13-80c7-bd4370cf61a8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:31.920808 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a6d89bc1-6b67-4c13-80c7-bd4370cf61a8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:31.940043 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a6d89bc1-6b67-4c13-80c7-bd4370cf61a8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:31.940838 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a6d89bc1-6b67-4c13-80c7-bd4370cf61a8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:31.941301 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a6d89bc1-6b67-4c13-80c7-bd4370cf61a8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:31.969788 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-97b9070e-2df1-4182-8796-dd3ee636b48f req-7101abe7-2bc7-41c1-8803-02e0f98b0fad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d", "tag": "3048ed1f-ed3c-4ece-8895-278d40e90955"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:44:31.983024 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-97b9070e-2df1-4182-8796-dd3ee636b48f req-7101abe7-2bc7-41c1-8803-02e0f98b0fad service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:31.983467 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-97b9070e-2df1-4182-8796-dd3ee636b48f req-7101abe7-2bc7-41c1-8803-02e0f98b0fad service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:32.003494 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-97b9070e-2df1-4182-8796-dd3ee636b48f req-7101abe7-2bc7-41c1-8803-02e0f98b0fad service nova] Creating event network-changed:3048ed1f-ed3c-4ece-8895-278d40e90955 for instance 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d on hv-cinder-79760 Jul 01 16:44:32.008465 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-97b9070e-2df1-4182-8796-dd3ee636b48f req-7101abe7-2bc7-41c1-8803-02e0f98b0fad service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042348 Jul 01 16:44:32.009054 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 277/544] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:44:32.154091 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a6d89bc1-6b67-4c13-80c7-bd4370cf61a8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:32.164230 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a6d89bc1-6b67-4c13-80c7-bd4370cf61a8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1734 microversion: 2.1 time: 0.258115 Jul 01 16:44:32.164823 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 268/545] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:31 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1734 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:33.185075 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-64ed8f5a-5911-422f-8868-16bce5ac99ce tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:33.185793 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-64ed8f5a-5911-422f-8868-16bce5ac99ce tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:33.191961 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-64ed8f5a-5911-422f-8868-16bce5ac99ce tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:33.192407 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-64ed8f5a-5911-422f-8868-16bce5ac99ce tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:33.193166 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-64ed8f5a-5911-422f-8868-16bce5ac99ce tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:33.193598 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-64ed8f5a-5911-422f-8868-16bce5ac99ce tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:33.328054 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-64ed8f5a-5911-422f-8868-16bce5ac99ce tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:33.336151 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-64ed8f5a-5911-422f-8868-16bce5ac99ce tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1734 microversion: 2.1 time: 0.155786 Jul 01 16:44:33.336722 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 278/546] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:33 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:34.355487 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-644bd75f-b890-4c8e-b9fd-38f0bbd3e91e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:34.355979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-644bd75f-b890-4c8e-b9fd-38f0bbd3e91e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:34.358241 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:44:34.363608 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-644bd75f-b890-4c8e-b9fd-38f0bbd3e91e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:34.364037 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-644bd75f-b890-4c8e-b9fd-38f0bbd3e91e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:34.364787 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-644bd75f-b890-4c8e-b9fd-38f0bbd3e91e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:34.365247 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-644bd75f-b890-4c8e-b9fd-38f0bbd3e91e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:34.513252 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-644bd75f-b890-4c8e-b9fd-38f0bbd3e91e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:34.521271 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-644bd75f-b890-4c8e-b9fd-38f0bbd3e91e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1734 microversion: 2.1 time: 0.170962 Jul 01 16:44:34.521838 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 269/547] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:34 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:35.538951 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a66a8f58-0d3f-4bd5-8f07-b328313affcf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:35.540082 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a66a8f58-0d3f-4bd5-8f07-b328313affcf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:35.548531 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a66a8f58-0d3f-4bd5-8f07-b328313affcf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:35.549270 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a66a8f58-0d3f-4bd5-8f07-b328313affcf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:35.550088 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a66a8f58-0d3f-4bd5-8f07-b328313affcf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:35.550556 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a66a8f58-0d3f-4bd5-8f07-b328313affcf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:35.770933 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a66a8f58-0d3f-4bd5-8f07-b328313affcf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:35.796196 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a66a8f58-0d3f-4bd5-8f07-b328313affcf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1734 microversion: 2.1 time: 0.261081 Jul 01 16:44:35.797309 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 279/548] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:35 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1734 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:36.815956 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-226db4ad-087f-42a4-8cf0-cc7f9dc88ac1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:36.816596 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-226db4ad-087f-42a4-8cf0-cc7f9dc88ac1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:36.824454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-226db4ad-087f-42a4-8cf0-cc7f9dc88ac1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:36.825293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-226db4ad-087f-42a4-8cf0-cc7f9dc88ac1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:36.826305 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-226db4ad-087f-42a4-8cf0-cc7f9dc88ac1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:36.827079 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-226db4ad-087f-42a4-8cf0-cc7f9dc88ac1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:37.017595 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-226db4ad-087f-42a4-8cf0-cc7f9dc88ac1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:37.039442 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-226db4ad-087f-42a4-8cf0-cc7f9dc88ac1 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1734 microversion: 2.1 time: 0.227310 Jul 01 16:44:37.051503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 270/549] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:36 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1734 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:38.068378 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-711298fd-bbc8-4b47-98fd-de558155a2cf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:38.069836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-711298fd-bbc8-4b47-98fd-de558155a2cf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:38.076313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:44:38.079368 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-711298fd-bbc8-4b47-98fd-de558155a2cf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:38.080088 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-711298fd-bbc8-4b47-98fd-de558155a2cf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:38.081112 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-711298fd-bbc8-4b47-98fd-de558155a2cf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:38.081881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-711298fd-bbc8-4b47-98fd-de558155a2cf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:38.256485 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-711298fd-bbc8-4b47-98fd-de558155a2cf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:38.266609 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-711298fd-bbc8-4b47-98fd-de558155a2cf tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1734 microversion: 2.1 time: 0.201983 Jul 01 16:44:38.267714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 280/550] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:38 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1734 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:39.287345 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c94bb4bf-5faf-43a6-9af9-118c5728f46c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:39.287956 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c94bb4bf-5faf-43a6-9af9-118c5728f46c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:39.294898 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c94bb4bf-5faf-43a6-9af9-118c5728f46c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:39.295346 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c94bb4bf-5faf-43a6-9af9-118c5728f46c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:39.296196 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c94bb4bf-5faf-43a6-9af9-118c5728f46c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:39.296626 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c94bb4bf-5faf-43a6-9af9-118c5728f46c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:39.436244 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c94bb4bf-5faf-43a6-9af9-118c5728f46c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:39.445092 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c94bb4bf-5faf-43a6-9af9-118c5728f46c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1734 microversion: 2.1 time: 0.164167 Jul 01 16:44:39.445687 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 271/551] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:39 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:40.464104 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3f65ad2d-abe6-46e6-b937-0ba6d8d06cac tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:40.465400 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3f65ad2d-abe6-46e6-b937-0ba6d8d06cac tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:40.475356 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f65ad2d-abe6-46e6-b937-0ba6d8d06cac tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:40.476098 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f65ad2d-abe6-46e6-b937-0ba6d8d06cac tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:40.477110 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f65ad2d-abe6-46e6-b937-0ba6d8d06cac tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:40.477700 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f65ad2d-abe6-46e6-b937-0ba6d8d06cac tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:40.752534 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3f65ad2d-abe6-46e6-b937-0ba6d8d06cac tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:40.769817 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3f65ad2d-abe6-46e6-b937-0ba6d8d06cac tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1734 microversion: 2.1 time: 0.309889 Jul 01 16:44:40.771218 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 281/552] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:40 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1734 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:44:41.793370 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5d8c0c50-3b4f-4364-b436-9fbc3c957bd7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:41.793972 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5d8c0c50-3b4f-4364-b436-9fbc3c957bd7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:41.814933 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5d8c0c50-3b4f-4364-b436-9fbc3c957bd7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:41.815538 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5d8c0c50-3b4f-4364-b436-9fbc3c957bd7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:41.816356 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5d8c0c50-3b4f-4364-b436-9fbc3c957bd7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:41.817455 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5d8c0c50-3b4f-4364-b436-9fbc3c957bd7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:42.130051 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5d8c0c50-3b4f-4364-b436-9fbc3c957bd7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:42.140793 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5d8c0c50-3b4f-4364-b436-9fbc3c957bd7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1734 microversion: 2.1 time: 0.351619 Jul 01 16:44:42.151523 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 272/553] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:41 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1734 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:43.158396 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-dd605059-c7e9-4c22-9b86-c05d510d2bda tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:43.159152 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-dd605059-c7e9-4c22-9b86-c05d510d2bda tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:43.180200 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dd605059-c7e9-4c22-9b86-c05d510d2bda tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:43.180920 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dd605059-c7e9-4c22-9b86-c05d510d2bda tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:43.187620 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dd605059-c7e9-4c22-9b86-c05d510d2bda tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:43.188321 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dd605059-c7e9-4c22-9b86-c05d510d2bda tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:43.419365 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-dd605059-c7e9-4c22-9b86-c05d510d2bda tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:43.429232 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-dd605059-c7e9-4c22-9b86-c05d510d2bda tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1734 microversion: 2.1 time: 0.274096 Jul 01 16:44:43.439758 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 282/554] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:43 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1734 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:44.297541 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a41d0e83-926a-4bd9-9c55-d90cc94e3f94 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Action: 'create', calling method: .version_select at 0x7fa86c42f670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-611014614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0r1utmvQcgceyJ531NPSIZT8c5UWfsKEjy9DDSFpnno/iMnUq7rnoWG3W36OpAsAGNhnvF/W7y19a+eryuFa3fQ1opfEzCJt7GtdX76qwntOxu6bM7Z9ErDNHQvMlMyw=="}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:44:44.312765 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-a41d0e83-926a-4bd9-9c55-d90cc94e3f94 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Getting quotas for project 0076c4e65bce4bd58478d09d62607981. Resources: {'key_pairs'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:44:44.316573 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-a41d0e83-926a-4bd9-9c55-d90cc94e3f94 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Getting quotas for user d6589e2636dd46838a3a0c66d18e0d00 and project 0076c4e65bce4bd58478d09d62607981. Resources: {'key_pairs'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:44:44.342294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a41d0e83-926a-4bd9-9c55-d90cc94e3f94 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.255208 Jul 01 16:44:44.342952 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 273/555] 10.222.0.57 () {60 vars in 1158 bytes} [Fri Jul 1 16:44:44 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:44:44.450374 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-965846d4-7809-43d9-9e08-4a24ff67ac97 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:44.451742 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-965846d4-7809-43d9-9e08-4a24ff67ac97 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:44.460014 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-965846d4-7809-43d9-9e08-4a24ff67ac97 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:44.460695 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-965846d4-7809-43d9-9e08-4a24ff67ac97 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:44.461712 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-965846d4-7809-43d9-9e08-4a24ff67ac97 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:44.462146 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-965846d4-7809-43d9-9e08-4a24ff67ac97 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:44.673013 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-965846d4-7809-43d9-9e08-4a24ff67ac97 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:44.681942 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-965846d4-7809-43d9-9e08-4a24ff67ac97 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1734 microversion: 2.1 time: 0.238149 Jul 01 16:44:44.683211 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 283/556] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:44 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1734 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:45.544505 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-cde7d643-86b1-4e60-8f18-28a2d93e11f3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:45.545052 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-cde7d643-86b1-4e60-8f18-28a2d93e11f3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:45.552592 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cde7d643-86b1-4e60-8f18-28a2d93e11f3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:45.553229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cde7d643-86b1-4e60-8f18-28a2d93e11f3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:45.554177 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cde7d643-86b1-4e60-8f18-28a2d93e11f3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:45.555040 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cde7d643-86b1-4e60-8f18-28a2d93e11f3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:45.616227 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-cde7d643-86b1-4e60-8f18-28a2d93e11f3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c/os-volume_attachments/37be8928-36ed-458f-93ba-e86a735e2341" status: 200 len: 194 microversion: 2.20 time: 0.077456 Jul 01 16:44:45.616833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 274/557] 10.222.0.57 () {60 vars in 1453 bytes} [Fri Jul 1 16:44:45 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c/os-volume_attachments/37be8928-36ed-458f-93ba-e86a735e2341 => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 16:44:45.692722 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c0044714-02cc-4149-a0b8-918f334e468d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:45.693286 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c0044714-02cc-4149-a0b8-918f334e468d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:45.703101 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-db526214-4243-4fb5-904d-fb2864a2f892 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:45.704258 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c0044714-02cc-4149-a0b8-918f334e468d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:45.704710 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c0044714-02cc-4149-a0b8-918f334e468d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:45.704907 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-db526214-4243-4fb5-904d-fb2864a2f892 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:45.705488 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c0044714-02cc-4149-a0b8-918f334e468d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:45.705916 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c0044714-02cc-4149-a0b8-918f334e468d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:45.717093 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-db526214-4243-4fb5-904d-fb2864a2f892 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:45.717502 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-db526214-4243-4fb5-904d-fb2864a2f892 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:45.718294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-db526214-4243-4fb5-904d-fb2864a2f892 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:45.718784 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-db526214-4243-4fb5-904d-fb2864a2f892 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:45.935161 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-c0044714-02cc-4149-a0b8-918f334e468d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lazy-loading 'services' on Instance uuid 8498c0a8-d20e-4261-a0a1-d4c33004141c {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:44:45.940875 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-db526214-4243-4fb5-904d-fb2864a2f892 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:45.950573 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-db526214-4243-4fb5-904d-fb2864a2f892 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1734 microversion: 2.1 time: 0.254325 Jul 01 16:44:45.951144 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 275/558] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:45 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1734 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:44:46.065135 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c0044714-02cc-4149-a0b8-918f334e468d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c/os-volume_attachments/37be8928-36ed-458f-93ba-e86a735e2341" status: 202 len: 0 microversion: 2.20 time: 0.376064 Jul 01 16:44:46.066008 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 284/559] 10.222.0.57 () {60 vars in 1456 bytes} [Fri Jul 1 16:44:45 2022] DELETE /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c/os-volume_attachments/37be8928-36ed-458f-93ba-e86a735e2341 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 16:44:46.076210 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3d6da4f1-7429-44db-b964-4ca87de3b19e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:46.077141 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3d6da4f1-7429-44db-b964-4ca87de3b19e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:46.083835 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3d6da4f1-7429-44db-b964-4ca87de3b19e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:46.084624 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3d6da4f1-7429-44db-b964-4ca87de3b19e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:46.085523 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3d6da4f1-7429-44db-b964-4ca87de3b19e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:46.086118 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3d6da4f1-7429-44db-b964-4ca87de3b19e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:46.132180 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3d6da4f1-7429-44db-b964-4ca87de3b19e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060501 Jul 01 16:44:46.132855 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 276/560] 10.222.0.57 () {60 vars in 1342 bytes} [Fri Jul 1 16:44:46 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 16:44:46.969547 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-afd46264-9ee2-4f48-82e6-a2529a27fce2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:46.970169 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-afd46264-9ee2-4f48-82e6-a2529a27fce2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:46.976400 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-afd46264-9ee2-4f48-82e6-a2529a27fce2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:46.976856 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-afd46264-9ee2-4f48-82e6-a2529a27fce2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:46.977628 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-afd46264-9ee2-4f48-82e6-a2529a27fce2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:46.978906 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-afd46264-9ee2-4f48-82e6-a2529a27fce2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:47.127568 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-afd46264-9ee2-4f48-82e6-a2529a27fce2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:47.136750 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-afd46264-9ee2-4f48-82e6-a2529a27fce2 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1714 microversion: 2.1 time: 0.171985 Jul 01 16:44:47.137300 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 285/561] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:46 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1714 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:44:47.144612 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-65420b38-9a73-4a64-8a7c-b8d081a10451 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:47.146127 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-65420b38-9a73-4a64-8a7c-b8d081a10451 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:47.154616 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-65420b38-9a73-4a64-8a7c-b8d081a10451 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:47.155012 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-65420b38-9a73-4a64-8a7c-b8d081a10451 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:47.155934 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-65420b38-9a73-4a64-8a7c-b8d081a10451 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:47.156973 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-65420b38-9a73-4a64-8a7c-b8d081a10451 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:47.225511 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-65420b38-9a73-4a64-8a7c-b8d081a10451 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084683 Jul 01 16:44:47.230238 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 277/562] 10.222.0.57 () {60 vars in 1342 bytes} [Fri Jul 1 16:44:47 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 16:44:47.274762 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3b401042-4888-4f39-a2da-ce31a6be09ab tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:47.276031 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3b401042-4888-4f39-a2da-ce31a6be09ab tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:47.282377 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3b401042-4888-4f39-a2da-ce31a6be09ab tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:47.282850 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3b401042-4888-4f39-a2da-ce31a6be09ab tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:47.283624 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3b401042-4888-4f39-a2da-ce31a6be09ab tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:47.284057 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3b401042-4888-4f39-a2da-ce31a6be09ab tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:47.379289 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-3b401042-4888-4f39-a2da-ce31a6be09ab tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] HTTP exception thrown: Cannot 'detach_volume' instance f084bd09-4d9f-4dfc-8166-711a8c80cbee while it is in vm_state rescued Jul 01 16:44:47.381073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3b401042-4888-4f39-a2da-ce31a6be09ab tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Request method failure captured: Jul 01 16:44:47.381073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: DELETE /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee/os-volume_attachments/f09a1698-2666-417c-82e7-43313dfb3252 HTTP/1.1 Jul 01 16:44:47.381073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:44:47.381073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:44:47.381073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:44:47.381073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:44:47.381073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:44:47.381073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:44:47.381073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:44:47.381073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:44:47.381073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyOI-s3iPDB4YLflXSSRZWcau0vhHiVagbazYRJFMf9-OokthaqI0R_YfsAgJ8HN57hiV6pLMlhwp8sGg5hnPn2V7hGYaEstnvtMh8Gwcl3eCgjot-5oXe0pZAz2Wj1DG2Utw8Q4W96USbDVD_e5F1KghjdjHfBU_BAZG2dmgSw5D10 Jul 01 16:44:47.381073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:44:47.381073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:44:47.381073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:44:47.381073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:44:47.381073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:44:47.381073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:44:47.381073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: bf55d220c94d4445af9f73c532029e42 Jul 01 16:44:47.381073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1802263634 Jul 01 16:44:47.381073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:44:47.381073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:44:47.382429 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bf55d220c94d4445af9f73c532029e42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bf55d220c94d4445af9f73c532029e42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bf55d220c94d4445af9f73c532029e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bf55d220c94d4445af9f73c532029e42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:44:47.382429 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1802263634 Jul 01 16:44:47.382429 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: bf55d220c94d4445af9f73c532029e42 Jul 01 16:44:47.382429 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1802263634 Jul 01 16:44:47.382429 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-ServerRescueNegativeTestJSON-1802263634-project Jul 01 16:44:47.382429 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:44:47.382429 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:44:47.382429 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: 71c383c04f9543d8ab97a6c0db268ca5 Jul 01 16:44:47.382429 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1802263634-project Jul 01 16:44:47.382429 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: > Jul 01 16:44:47.382429 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Cannot 'detach_volume' instance f084bd09-4d9f-4dfc-8166-711a8c80cbee while it is in vm_state rescued Jul 01 16:44:47.383138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'server_id': 'f084bd09-4d9f-4dfc-8166-711a8c80cbee', 'id': 'f09a1698-2666-417c-82e7-43313dfb3252'} Jul 01 16:44:47.383138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:44:47.383138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:44:47.383138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 01 16:44:47.383138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 01 16:44:47.383138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 16:44:47.383138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 16:44:47.383138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 16:44:47.383138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 16:44:47.383138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f084bd09-4d9f-4dfc-8166-711a8c80cbee in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 01 16:44:47.383138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:44:47.383138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:44:47.383138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:44:47.383138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:44:47.383138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:44:47.383138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:44:47.383138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:44:47.383138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:44:47.383138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:44:47.383138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:44:47.385314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 01 16:44:47.385314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 16:44:47.385314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 16:44:47.385314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 16:44:47.385314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f084bd09-4d9f-4dfc-8166-711a8c80cbee while it is in vm_state rescued Jul 01 16:44:47.385314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:44:47.385314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:44:47.385314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:44:47.385314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:44:47.385314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:44:47.385314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:44:47.385314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:44:47.385314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:44:47.385314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f084bd09-4d9f-4dfc-8166-711a8c80cbee while it is in vm_state rescued Jul 01 16:44:47.385314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:44:47.385314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3b401042-4888-4f39-a2da-ce31a6be09ab tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Returning 409 to user: Cannot 'detach_volume' instance f084bd09-4d9f-4dfc-8166-711a8c80cbee while it is in vm_state rescued {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:44:47.386481 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3b401042-4888-4f39-a2da-ce31a6be09ab tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee/os-volume_attachments/f09a1698-2666-417c-82e7-43313dfb3252" status: 409 len: 152 microversion: 2.1 time: 0.111914 Jul 01 16:44:47.386481 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 286/563] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 1 16:44:47 2022] DELETE /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee/os-volume_attachments/f09a1698-2666-417c-82e7-43313dfb3252 => generated 152 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 01 16:44:47.393032 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7f87fff5-942e-4abd-b30e-0a97a8f929da tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:44:47.393746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7f87fff5-942e-4abd-b30e-0a97a8f929da tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:47.407018 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7f87fff5-942e-4abd-b30e-0a97a8f929da tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:47.407902 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7f87fff5-942e-4abd-b30e-0a97a8f929da tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:47.409282 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7f87fff5-942e-4abd-b30e-0a97a8f929da tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:47.410284 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7f87fff5-942e-4abd-b30e-0a97a8f929da tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:47.487884 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7f87fff5-942e-4abd-b30e-0a97a8f929da tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "POST /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee/action" status: 202 len: 0 microversion: 2.1 time: 0.099432 Jul 01 16:44:47.488795 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 278/564] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 1 16:44:47 2022] POST /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:44:47.498255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-bdd0f173-004e-4add-b204-910dfac04323 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:47.499231 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-bdd0f173-004e-4add-b204-910dfac04323 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:47.511621 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bdd0f173-004e-4add-b204-910dfac04323 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:47.512498 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bdd0f173-004e-4add-b204-910dfac04323 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:47.513579 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bdd0f173-004e-4add-b204-910dfac04323 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:47.514476 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bdd0f173-004e-4add-b204-910dfac04323 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:47.804217 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-bdd0f173-004e-4add-b204-910dfac04323 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:47.819675 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-bdd0f173-004e-4add-b204-910dfac04323 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1722 microversion: 2.1 time: 0.326424 Jul 01 16:44:47.820412 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 287/565] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:47 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1722 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:48.238208 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-cd7f1789-0483-42b2-b4df-e3bb3907b912 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:48.240251 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-cd7f1789-0483-42b2-b4df-e3bb3907b912 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:48.250781 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cd7f1789-0483-42b2-b4df-e3bb3907b912 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:48.251942 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cd7f1789-0483-42b2-b4df-e3bb3907b912 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:48.253988 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cd7f1789-0483-42b2-b4df-e3bb3907b912 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:48.254926 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cd7f1789-0483-42b2-b4df-e3bb3907b912 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:48.315730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-cd7f1789-0483-42b2-b4df-e3bb3907b912 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.080445 Jul 01 16:44:48.316704 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 279/566] 10.222.0.57 () {60 vars in 1342 bytes} [Fri Jul 1 16:44:48 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:48.420674 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-080572dd-0728-4ab0-aef3-2563c5e21d87 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:48.422861 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-080572dd-0728-4ab0-aef3-2563c5e21d87 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:48.431522 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-080572dd-0728-4ab0-aef3-2563c5e21d87 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:48.432697 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-080572dd-0728-4ab0-aef3-2563c5e21d87 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:48.433613 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-080572dd-0728-4ab0-aef3-2563c5e21d87 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:48.434149 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-080572dd-0728-4ab0-aef3-2563c5e21d87 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:48.437397 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:44:48.470236 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-080572dd-0728-4ab0-aef3-2563c5e21d87 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 16:44:48.572305 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-080572dd-0728-4ab0-aef3-2563c5e21d87 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 204 len: 0 microversion: 2.20 time: 0.155783 Jul 01 16:44:48.580529 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 288/567] 10.222.0.57 () {60 vars in 1279 bytes} [Fri Jul 1 16:44:48 2022] DELETE /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 16:44:48.588052 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1bc9c3c8-750d-495c-9c4b-928226ce0b30 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:48.588823 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1bc9c3c8-750d-495c-9c4b-928226ce0b30 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:48.599322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1bc9c3c8-750d-495c-9c4b-928226ce0b30 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:48.600002 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1bc9c3c8-750d-495c-9c4b-928226ce0b30 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:48.600888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1bc9c3c8-750d-495c-9c4b-928226ce0b30 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:48.601456 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1bc9c3c8-750d-495c-9c4b-928226ce0b30 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:48.753829 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1bc9c3c8-750d-495c-9c4b-928226ce0b30 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:48.769661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1bc9c3c8-750d-495c-9c4b-928226ce0b30 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:48.772603 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1bc9c3c8-750d-495c-9c4b-928226ce0b30 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:48.774084 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1bc9c3c8-750d-495c-9c4b-928226ce0b30 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1721 microversion: 2.20 time: 0.191237 Jul 01 16:44:48.774885 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 280/568] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:44:48 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:44:48.840644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1ed540ec-82ce-4dba-a2b3-017ba348a322 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:48.841471 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1ed540ec-82ce-4dba-a2b3-017ba348a322 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:48.847884 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1ed540ec-82ce-4dba-a2b3-017ba348a322 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:48.848333 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1ed540ec-82ce-4dba-a2b3-017ba348a322 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:48.849118 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1ed540ec-82ce-4dba-a2b3-017ba348a322 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:48.849557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1ed540ec-82ce-4dba-a2b3-017ba348a322 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:48.994796 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-1ed540ec-82ce-4dba-a2b3-017ba348a322 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:49.003947 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1ed540ec-82ce-4dba-a2b3-017ba348a322 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1722 microversion: 2.1 time: 0.167856 Jul 01 16:44:49.004519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 289/569] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:48 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:49.796269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b93d878a-4d39-4658-bea5-85de60624e94 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:49.796878 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b93d878a-4d39-4658-bea5-85de60624e94 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:49.803624 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b93d878a-4d39-4658-bea5-85de60624e94 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:49.804074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b93d878a-4d39-4658-bea5-85de60624e94 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:49.804857 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b93d878a-4d39-4658-bea5-85de60624e94 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:49.805287 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b93d878a-4d39-4658-bea5-85de60624e94 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:49.955941 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b93d878a-4d39-4658-bea5-85de60624e94 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:49.964994 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b93d878a-4d39-4658-bea5-85de60624e94 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:49.966525 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b93d878a-4d39-4658-bea5-85de60624e94 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:49.967683 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b93d878a-4d39-4658-bea5-85de60624e94 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1721 microversion: 2.20 time: 0.175357 Jul 01 16:44:49.968238 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 281/570] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:44:49 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:44:50.022765 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-48d9f78c-982e-436f-b0b3-2d4d796e9864 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:50.023382 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-48d9f78c-982e-436f-b0b3-2d4d796e9864 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:50.033950 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-48d9f78c-982e-436f-b0b3-2d4d796e9864 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:50.034733 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-48d9f78c-982e-436f-b0b3-2d4d796e9864 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:50.035919 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-48d9f78c-982e-436f-b0b3-2d4d796e9864 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:50.036450 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-48d9f78c-982e-436f-b0b3-2d4d796e9864 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:50.171474 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-48d9f78c-982e-436f-b0b3-2d4d796e9864 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:50.184083 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-48d9f78c-982e-436f-b0b3-2d4d796e9864 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1722 microversion: 2.1 time: 0.165491 Jul 01 16:44:50.185149 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 290/571] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:50 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:50.986252 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7aa96346-e5b6-4549-9761-f4a2b4c2db15 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:50.986882 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7aa96346-e5b6-4549-9761-f4a2b4c2db15 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:50.993552 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7aa96346-e5b6-4549-9761-f4a2b4c2db15 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:50.994094 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7aa96346-e5b6-4549-9761-f4a2b4c2db15 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:50.994900 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7aa96346-e5b6-4549-9761-f4a2b4c2db15 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:50.995329 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7aa96346-e5b6-4549-9761-f4a2b4c2db15 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:51.128807 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7aa96346-e5b6-4549-9761-f4a2b4c2db15 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:51.137666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7aa96346-e5b6-4549-9761-f4a2b4c2db15 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:51.139264 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7aa96346-e5b6-4549-9761-f4a2b4c2db15 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:51.140400 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7aa96346-e5b6-4549-9761-f4a2b4c2db15 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1721 microversion: 2.20 time: 0.158129 Jul 01 16:44:51.140944 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 282/572] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:44:50 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:44:51.202820 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-7cd16fe6-34ab-4932-8b78-1a6b74182994 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:51.203434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-7cd16fe6-34ab-4932-8b78-1a6b74182994 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:51.211349 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7cd16fe6-34ab-4932-8b78-1a6b74182994 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:51.211805 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7cd16fe6-34ab-4932-8b78-1a6b74182994 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:51.213450 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7cd16fe6-34ab-4932-8b78-1a6b74182994 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:51.214248 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7cd16fe6-34ab-4932-8b78-1a6b74182994 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:51.354103 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7cd16fe6-34ab-4932-8b78-1a6b74182994 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:51.362118 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-7cd16fe6-34ab-4932-8b78-1a6b74182994 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1722 microversion: 2.1 time: 0.163127 Jul 01 16:44:51.362719 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 291/573] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:51 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:52.159226 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-fd828583-f58a-4b33-9928-062c3f1e1bd4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:52.159829 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-fd828583-f58a-4b33-9928-062c3f1e1bd4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:52.167186 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fd828583-f58a-4b33-9928-062c3f1e1bd4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:52.167636 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fd828583-f58a-4b33-9928-062c3f1e1bd4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:52.168406 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fd828583-f58a-4b33-9928-062c3f1e1bd4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:52.168841 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fd828583-f58a-4b33-9928-062c3f1e1bd4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:52.183340 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:44:52.347936 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-fd828583-f58a-4b33-9928-062c3f1e1bd4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:52.356760 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-fd828583-f58a-4b33-9928-062c3f1e1bd4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:52.358252 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-fd828583-f58a-4b33-9928-062c3f1e1bd4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:52.359409 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-fd828583-f58a-4b33-9928-062c3f1e1bd4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1721 microversion: 2.20 time: 0.204055 Jul 01 16:44:52.359958 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 283/574] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:44:52 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:44:52.380657 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5e286e9a-751f-4237-b9d1-039c2786da0e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:52.381273 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5e286e9a-751f-4237-b9d1-039c2786da0e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:52.388578 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5e286e9a-751f-4237-b9d1-039c2786da0e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:52.389025 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5e286e9a-751f-4237-b9d1-039c2786da0e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:52.389796 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5e286e9a-751f-4237-b9d1-039c2786da0e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:52.390238 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5e286e9a-751f-4237-b9d1-039c2786da0e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:52.560670 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5e286e9a-751f-4237-b9d1-039c2786da0e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:52.568863 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5e286e9a-751f-4237-b9d1-039c2786da0e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1722 microversion: 2.1 time: 0.192376 Jul 01 16:44:52.569438 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 292/575] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:52 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:53.347946 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-8f50b270-0e99-4a2d-80e7-0e88d79f5c10 req-2c6aa38c-53bb-49cb-a5cb-ae8489414784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8498c0a8-d20e-4261-a0a1-d4c33004141c", "name": "network-vif-deleted", "tag": "2c1b8fc6-0b53-4c5c-83ee-2d68d226acfa"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:44:53.357924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-8f50b270-0e99-4a2d-80e7-0e88d79f5c10 req-2c6aa38c-53bb-49cb-a5cb-ae8489414784 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:53.358609 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-8f50b270-0e99-4a2d-80e7-0e88d79f5c10 req-2c6aa38c-53bb-49cb-a5cb-ae8489414784 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:53.372301 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-8f50b270-0e99-4a2d-80e7-0e88d79f5c10 req-2c6aa38c-53bb-49cb-a5cb-ae8489414784 service nova] Creating event network-vif-deleted:2c1b8fc6-0b53-4c5c-83ee-2d68d226acfa for instance 8498c0a8-d20e-4261-a0a1-d4c33004141c on hv-cinder-79760 Jul 01 16:44:53.377337 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-222c9fcf-4c75-44d8-afea-fd991162fda6 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:53.378387 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-222c9fcf-4c75-44d8-afea-fd991162fda6 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:53.378820 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-8f50b270-0e99-4a2d-80e7-0e88d79f5c10 req-2c6aa38c-53bb-49cb-a5cb-ae8489414784 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033627 Jul 01 16:44:53.385079 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 284/576] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:44:53.385862 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-222c9fcf-4c75-44d8-afea-fd991162fda6 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:53.386873 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-222c9fcf-4c75-44d8-afea-fd991162fda6 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:53.387618 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-222c9fcf-4c75-44d8-afea-fd991162fda6 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:53.388205 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-222c9fcf-4c75-44d8-afea-fd991162fda6 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:53.461413 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-222c9fcf-4c75-44d8-afea-fd991162fda6 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:53.475373 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-222c9fcf-4c75-44d8-afea-fd991162fda6 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:53.477111 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-222c9fcf-4c75-44d8-afea-fd991162fda6 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:53.478663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-222c9fcf-4c75-44d8-afea-fd991162fda6 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 200 len: 1366 microversion: 2.20 time: 0.105220 Jul 01 16:44:53.487033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 293/577] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:44:53 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 1366 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:44:53.588038 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c6e1cc5a-a33a-4cd8-9d78-76103ab76009 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:53.588962 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c6e1cc5a-a33a-4cd8-9d78-76103ab76009 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:53.595711 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c6e1cc5a-a33a-4cd8-9d78-76103ab76009 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:53.596271 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c6e1cc5a-a33a-4cd8-9d78-76103ab76009 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:53.597112 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c6e1cc5a-a33a-4cd8-9d78-76103ab76009 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:53.597611 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c6e1cc5a-a33a-4cd8-9d78-76103ab76009 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:53.742149 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c6e1cc5a-a33a-4cd8-9d78-76103ab76009 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:53.751961 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c6e1cc5a-a33a-4cd8-9d78-76103ab76009 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1728 microversion: 2.1 time: 0.168494 Jul 01 16:44:53.759699 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 285/578] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:44:53 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:44:53.770272 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8e683804-f6d5-4ea6-bfa1-190bb2cf3ae7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:53.770799 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8e683804-f6d5-4ea6-bfa1-190bb2cf3ae7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:53.778685 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8e683804-f6d5-4ea6-bfa1-190bb2cf3ae7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:53.779172 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8e683804-f6d5-4ea6-bfa1-190bb2cf3ae7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:53.780007 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8e683804-f6d5-4ea6-bfa1-190bb2cf3ae7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:53.780432 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8e683804-f6d5-4ea6-bfa1-190bb2cf3ae7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:53.861180 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8e683804-f6d5-4ea6-bfa1-190bb2cf3ae7 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094985 Jul 01 16:44:53.861889 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 294/579] 10.222.0.57 () {58 vars in 1274 bytes} [Fri Jul 1 16:44:53 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:44:54.496604 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-89bdc0bb-bb3a-46ae-afdc-063b77f9cb43 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:54.497163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-89bdc0bb-bb3a-46ae-afdc-063b77f9cb43 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:54.499186 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=4 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:44:54.505274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-89bdc0bb-bb3a-46ae-afdc-063b77f9cb43 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:54.505728 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-89bdc0bb-bb3a-46ae-afdc-063b77f9cb43 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:54.506530 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-89bdc0bb-bb3a-46ae-afdc-063b77f9cb43 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:54.506979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-89bdc0bb-bb3a-46ae-afdc-063b77f9cb43 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:54.520781 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-89bdc0bb-bb3a-46ae-afdc-063b77f9cb43 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] HTTP exception thrown: Instance 8498c0a8-d20e-4261-a0a1-d4c33004141c could not be found. Jul 01 16:44:54.522453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-89bdc0bb-bb3a-46ae-afdc-063b77f9cb43 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Request method failure captured: Jul 01 16:44:54.522453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c HTTP/1.1 Jul 01 16:44:54.522453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:44:54.522453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:44:54.522453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:44:54.522453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:44:54.522453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:44:54.522453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:44:54.522453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:44:54.522453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:44:54.522453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyOEX7ZmlTowDJwBQle8fYRN6IIl6cTBoh3cWOEW-kmdqj74LprtFmwsfqVRVjL-Wk63ndafCHfHFjx80r_bi-PQhBVTV7Gpu8Kd94vqCVQXw25-3mUMpJW2YxXzdceSiVS31Af7uO0Trb3QuorNPILu2OHvdPrBv3nnbYzAn2_m4b0 Jul 01 16:44:54.522453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:44:54.522453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:44:54.522453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:44:54.522453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:44:54.522453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 16:44:54.522453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:44:54.522453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:44:54.522453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: 315dd9cfab134d008039e1229e42a96e Jul 01 16:44:54.522453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-23441539 Jul 01 16:44:54.522453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:44:54.522453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:44:54.523952 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/315dd9cfab134d008039e1229e42a96e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/315dd9cfab134d008039e1229e42a96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_315dd9cfab134d008039e1229e42a96e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/315dd9cfab134d008039e1229e42a96e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:44:54.523952 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeShelveTestJSON-23441539 Jul 01 16:44:54.523952 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 315dd9cfab134d008039e1229e42a96e Jul 01 16:44:54.523952 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-23441539 Jul 01 16:44:54.523952 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeShelveTestJSON-23441539-project Jul 01 16:44:54.523952 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:44:54.523952 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:44:54.523952 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: e471b31763074167ba81c2c25f39b857 Jul 01 16:44:54.523952 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeShelveTestJSON-23441539-project Jul 01 16:44:54.523952 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:44:54.523952 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance 8498c0a8-d20e-4261-a0a1-d4c33004141c could not be found. Jul 01 16:44:54.523952 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': '8498c0a8-d20e-4261-a0a1-d4c33004141c'} Jul 01 16:44:54.525759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:44:54.525759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:44:54.525759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:44:54.525759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:44:54.525759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:44:54.525759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:44:54.525759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:44:54.525759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:44:54.525759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:44:54.525759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:44:54.525759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8498c0a8-d20e-4261-a0a1-d4c33004141c could not be found. Jul 01 16:44:54.525759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:44:54.525759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:44:54.525759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:44:54.525759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:44:54.525759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:44:54.525759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:44:54.525759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:44:54.525759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:44:54.525759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:44:54.527146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:44:54.527146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:44:54.527146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:44:54.527146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:44:54.527146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:44:54.527146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:44:54.527146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:44:54.527146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8498c0a8-d20e-4261-a0a1-d4c33004141c could not be found. Jul 01 16:44:54.527146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:44:54.527146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:44:54.527146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:44:54.527146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:44:54.527146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:44:54.527146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:44:54.527146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:44:54.527146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:44:54.527146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8498c0a8-d20e-4261-a0a1-d4c33004141c could not be found. Jul 01 16:44:54.527146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:44:54.528368 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-89bdc0bb-bb3a-46ae-afdc-063b77f9cb43 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Returning 404 to user: Instance 8498c0a8-d20e-4261-a0a1-d4c33004141c could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:44:54.528368 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-89bdc0bb-bb3a-46ae-afdc-063b77f9cb43 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 404 len: 111 microversion: 2.20 time: 0.031320 Jul 01 16:44:54.528368 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 286/580] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:44:54 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 01 16:44:54.534129 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-bd5b0705-b1a1-4313-ae0e-0cd4df0941e3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '.version_select at 0x7fa85ffc6dc0>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:54.552850 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-bd5b0705-b1a1-4313-ae0e-0cd4df0941e3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-739661522" status: 204 len: 0 microversion: 2.20 time: 0.023028 Jul 01 16:44:54.553433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 295/581] 10.222.0.57 () {60 vars in 1258 bytes} [Fri Jul 1 16:44:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-739661522 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 16:44:55.396842 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-f9702bc5-6f3a-4e8e-989d-14cf35842497 req-e9bb426c-4a17-4da5-b354-47848a2125f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f084bd09-4d9f-4dfc-8166-711a8c80cbee", "tag": "b1c38327-6c47-4d4f-bcc3-847a86785a63"}, {"name": "network-changed", "server_uuid": "f084bd09-4d9f-4dfc-8166-711a8c80cbee", "tag": "b1c38327-6c47-4d4f-bcc3-847a86785a63"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:44:55.423927 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-f9702bc5-6f3a-4e8e-989d-14cf35842497 req-e9bb426c-4a17-4da5-b354-47848a2125f7 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:55.424748 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-f9702bc5-6f3a-4e8e-989d-14cf35842497 req-e9bb426c-4a17-4da5-b354-47848a2125f7 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:55.439975 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-f9702bc5-6f3a-4e8e-989d-14cf35842497 req-e9bb426c-4a17-4da5-b354-47848a2125f7 service nova] Creating event network-changed:b1c38327-6c47-4d4f-bcc3-847a86785a63 for instance f084bd09-4d9f-4dfc-8166-711a8c80cbee on hv-cinder-79760 Jul 01 16:44:55.440730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-f9702bc5-6f3a-4e8e-989d-14cf35842497 req-e9bb426c-4a17-4da5-b354-47848a2125f7 service nova] Creating event network-changed:b1c38327-6c47-4d4f-bcc3-847a86785a63 for instance f084bd09-4d9f-4dfc-8166-711a8c80cbee on hv-cinder-79760 Jul 01 16:44:55.446593 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-f9702bc5-6f3a-4e8e-989d-14cf35842497 req-e9bb426c-4a17-4da5-b354-47848a2125f7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053636 Jul 01 16:44:55.448172 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 287/582] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:44:55.519889 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-70753d43-8f1c-443a-ace9-a6b9a5e696cd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Action: 'create', calling method: .version_select at 0x7fa85f36d5e0>, body: {"keypair": {"name": "tempest-keypair-1037522237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5LYD+AVBQEzKG+GjCtsCtnlYrY4uwBF6EcN38BJgqlhhllN3OQvcGDBVHMEP7JPa5JpaE2u5QcHYI0kkg4EzyZa5KnCVTstrQoLwvDpOUFf3ZzwDqFJ4ndbogMdAa2gw=="}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:44:55.550105 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-70753d43-8f1c-443a-ace9-a6b9a5e696cd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Getting quotas for project 315dd9cfab134d008039e1229e42a96e. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:44:55.557081 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-70753d43-8f1c-443a-ace9-a6b9a5e696cd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Getting quotas for user e471b31763074167ba81c2c25f39b857 and project 315dd9cfab134d008039e1229e42a96e. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:44:55.589043 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-70753d43-8f1c-443a-ace9-a6b9a5e696cd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.072981 Jul 01 16:44:55.589744 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 296/583] 10.222.0.57 () {62 vars in 1199 bytes} [Fri Jul 1 16:44:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 01 16:44:57.041888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e037df91-ed39-483d-bcc9-52d52785f049 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-444649329", "imageRef": "42a4b1a9-dea6-4c87-a2c1-328b9c0c8558", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "122e1655-ca16-42e2-ac40-3aa0137062fe"}], "security_groups": [{"name": "tempest-securitygroup--726133820"}], "key_name": "tempest-keypair-1037522237", "user_data": "}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:44:57.145667 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.network.neutron [None req-e037df91-ed39-483d-bcc9-52d52785f049 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] validate_networks() for [('122e1655-ca16-42e2-ac40-3aa0137062fe', None, None, None, None, None)] {{(pid=124317) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 16:44:57.530845 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-e037df91-ed39-483d-bcc9-52d52785f049 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Flavor limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 16:44:57.531296 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-e037df91-ed39-483d-bcc9-52d52785f049 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Image limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 16:44:57.531799 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-e037df91-ed39-483d-bcc9-52d52785f049 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Flavor pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 16:44:57.532240 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-e037df91-ed39-483d-bcc9-52d52785f049 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Image pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 16:44:57.532652 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-e037df91-ed39-483d-bcc9-52d52785f049 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 16:44:57.542168 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e037df91-ed39-483d-bcc9-52d52785f049 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:57.542679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e037df91-ed39-483d-bcc9-52d52785f049 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:57.543479 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e037df91-ed39-483d-bcc9-52d52785f049 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:57.543917 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e037df91-ed39-483d-bcc9-52d52785f049 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:57.560703 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-e037df91-ed39-483d-bcc9-52d52785f049 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Getting quotas for project 315dd9cfab134d008039e1229e42a96e. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:44:57.565572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-e037df91-ed39-483d-bcc9-52d52785f049 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Getting quotas for user e471b31763074167ba81c2c25f39b857 and project 315dd9cfab134d008039e1229e42a96e. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:44:57.578830 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e037df91-ed39-483d-bcc9-52d52785f049 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Going to run 1 instances... {{(pid=124317) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 16:44:57.581739 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e037df91-ed39-483d-bcc9-52d52785f049 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42a4b1a9-dea6-4c87-a2c1-328b9c0c8558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124317) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 16:44:57.631411 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e037df91-ed39-483d-bcc9-52d52785f049 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.595772 Jul 01 16:44:57.632062 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 288/584] 10.222.0.57 () {62 vars in 1187 bytes} [Fri Jul 1 16:44:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 01 16:44:57.645218 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9c6caa8f-0d8f-4d4e-be8c-e27f81d26b60 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:57.647861 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9c6caa8f-0d8f-4d4e-be8c-e27f81d26b60 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:57.705743 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9c6caa8f-0d8f-4d4e-be8c-e27f81d26b60 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:57.714717 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9c6caa8f-0d8f-4d4e-be8c-e27f81d26b60 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:57.716168 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9c6caa8f-0d8f-4d4e-be8c-e27f81d26b60 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:57.717395 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9c6caa8f-0d8f-4d4e-be8c-e27f81d26b60 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1281 microversion: 2.20 time: 0.078141 Jul 01 16:44:57.718307 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 297/585] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:44:57 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1281 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:44:58.735951 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1e8aed67-e5cf-49ae-a0ad-f3d6095f278b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:58.736559 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1e8aed67-e5cf-49ae-a0ad-f3d6095f278b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:58.742940 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1e8aed67-e5cf-49ae-a0ad-f3d6095f278b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:58.743941 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1e8aed67-e5cf-49ae-a0ad-f3d6095f278b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:58.744699 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1e8aed67-e5cf-49ae-a0ad-f3d6095f278b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:58.745134 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1e8aed67-e5cf-49ae-a0ad-f3d6095f278b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:58.823832 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1e8aed67-e5cf-49ae-a0ad-f3d6095f278b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:58.843719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1e8aed67-e5cf-49ae-a0ad-f3d6095f278b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:58.845606 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1e8aed67-e5cf-49ae-a0ad-f3d6095f278b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:44:58.847168 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1e8aed67-e5cf-49ae-a0ad-f3d6095f278b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1341 microversion: 2.20 time: 0.116394 Jul 01 16:44:58.856358 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 289/586] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:44:58 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1341 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:44:59.870665 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b7988f0c-bf93-45fe-9ccf-62a33740833a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:44:59.871533 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b7988f0c-bf93-45fe-9ccf-62a33740833a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:44:59.878697 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b7988f0c-bf93-45fe-9ccf-62a33740833a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:59.879261 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b7988f0c-bf93-45fe-9ccf-62a33740833a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:44:59.880106 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b7988f0c-bf93-45fe-9ccf-62a33740833a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:44:59.880616 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b7988f0c-bf93-45fe-9ccf-62a33740833a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:00.095212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b7988f0c-bf93-45fe-9ccf-62a33740833a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:00.104067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b7988f0c-bf93-45fe-9ccf-62a33740833a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:00.105577 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b7988f0c-bf93-45fe-9ccf-62a33740833a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:00.106722 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b7988f0c-bf93-45fe-9ccf-62a33740833a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1406 microversion: 2.20 time: 0.241234 Jul 01 16:45:00.107289 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 298/587] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:44:59 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:45:00.710075 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-3095f9db-efb2-47d2-b4f4-7ad8a40800c5 req-e60f9993-c49e-4312-bf0a-79bea437d098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8d5cf19-9bb2-4534-8076-564fb7538cad", "tag": "ca06c719-80eb-4c4d-b8cd-b06d9b34ab88"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:00.729521 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-3095f9db-efb2-47d2-b4f4-7ad8a40800c5 req-e60f9993-c49e-4312-bf0a-79bea437d098 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:00.729968 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-3095f9db-efb2-47d2-b4f4-7ad8a40800c5 req-e60f9993-c49e-4312-bf0a-79bea437d098 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:00.741674 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-3095f9db-efb2-47d2-b4f4-7ad8a40800c5 req-e60f9993-c49e-4312-bf0a-79bea437d098 service nova] Creating event network-changed:ca06c719-80eb-4c4d-b8cd-b06d9b34ab88 for instance d8d5cf19-9bb2-4534-8076-564fb7538cad on hv-cinder-79760 Jul 01 16:45:00.746647 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-3095f9db-efb2-47d2-b4f4-7ad8a40800c5 req-e60f9993-c49e-4312-bf0a-79bea437d098 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041284 Jul 01 16:45:00.747250 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 290/588] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:45:01.125670 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-72535884-bcc4-4a7b-b7aa-f18e175abb30 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:01.126291 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-72535884-bcc4-4a7b-b7aa-f18e175abb30 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:01.132787 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-72535884-bcc4-4a7b-b7aa-f18e175abb30 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:01.133242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-72535884-bcc4-4a7b-b7aa-f18e175abb30 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:01.134225 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-72535884-bcc4-4a7b-b7aa-f18e175abb30 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:01.134696 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-72535884-bcc4-4a7b-b7aa-f18e175abb30 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:01.285494 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-72535884-bcc4-4a7b-b7aa-f18e175abb30 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:01.294785 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-72535884-bcc4-4a7b-b7aa-f18e175abb30 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:01.296302 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-72535884-bcc4-4a7b-b7aa-f18e175abb30 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:01.297404 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-72535884-bcc4-4a7b-b7aa-f18e175abb30 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1406 microversion: 2.20 time: 0.175838 Jul 01 16:45:01.297968 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 299/589] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:45:01 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:45:02.316505 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-bb9491c7-cd4d-4d67-bc14-6c7eee8b23d9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:02.317201 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-bb9491c7-cd4d-4d67-bc14-6c7eee8b23d9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:02.324138 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bb9491c7-cd4d-4d67-bc14-6c7eee8b23d9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:02.324589 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bb9491c7-cd4d-4d67-bc14-6c7eee8b23d9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:02.325356 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bb9491c7-cd4d-4d67-bc14-6c7eee8b23d9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:02.325802 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bb9491c7-cd4d-4d67-bc14-6c7eee8b23d9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:02.462870 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bb9491c7-cd4d-4d67-bc14-6c7eee8b23d9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:02.470915 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bb9491c7-cd4d-4d67-bc14-6c7eee8b23d9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:02.472415 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bb9491c7-cd4d-4d67-bc14-6c7eee8b23d9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:02.473511 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-bb9491c7-cd4d-4d67-bc14-6c7eee8b23d9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1406 microversion: 2.20 time: 0.161799 Jul 01 16:45:02.474070 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 291/590] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:45:02 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:45:03.492029 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b9e5240c-b78f-4dce-bbcc-33cde94f3722 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:03.492671 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b9e5240c-b78f-4dce-bbcc-33cde94f3722 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:03.499437 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b9e5240c-b78f-4dce-bbcc-33cde94f3722 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:03.499889 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b9e5240c-b78f-4dce-bbcc-33cde94f3722 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:03.500649 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b9e5240c-b78f-4dce-bbcc-33cde94f3722 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:03.501089 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b9e5240c-b78f-4dce-bbcc-33cde94f3722 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:03.631608 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b9e5240c-b78f-4dce-bbcc-33cde94f3722 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:03.640555 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b9e5240c-b78f-4dce-bbcc-33cde94f3722 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:03.642073 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b9e5240c-b78f-4dce-bbcc-33cde94f3722 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:03.643221 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b9e5240c-b78f-4dce-bbcc-33cde94f3722 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1406 microversion: 2.20 time: 0.155215 Jul 01 16:45:03.643788 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 300/591] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:45:03 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:45:04.215107 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2625aa3e-4053-414a-856d-f39b1942422d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1910151000", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-611014614", "security_groups": [{"name": "tempest-secgroup-smoke-1604816131"}], "block_device_mapping_v2": [{"uuid": "b5fdd553-03a2-4d3a-aa22-5754153aa64e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6911cac0-9310-49e0-9165-12c7216cb763"}]}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:04.325383 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.network.neutron [None req-2625aa3e-4053-414a-856d-f39b1942422d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] validate_networks() for [('6911cac0-9310-49e0-9165-12c7216cb763', None, None, None, None, None)] {{(pid=124317) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 16:45:04.506122 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:45:04.661565 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4c13ef11-06b0-49f0-babf-9905d1a67892 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:04.662163 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4c13ef11-06b0-49f0-babf-9905d1a67892 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:04.669888 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4c13ef11-06b0-49f0-babf-9905d1a67892 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:04.670363 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4c13ef11-06b0-49f0-babf-9905d1a67892 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:04.671146 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4c13ef11-06b0-49f0-babf-9905d1a67892 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:04.671582 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4c13ef11-06b0-49f0-babf-9905d1a67892 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:04.701307 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-2625aa3e-4053-414a-856d-f39b1942422d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Flavor limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 16:45:04.701723 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-2625aa3e-4053-414a-856d-f39b1942422d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Image limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 16:45:04.702191 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-2625aa3e-4053-414a-856d-f39b1942422d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Flavor pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 16:45:04.703232 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-2625aa3e-4053-414a-856d-f39b1942422d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Image pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 16:45:04.703806 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-2625aa3e-4053-414a-856d-f39b1942422d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 16:45:04.713625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2625aa3e-4053-414a-856d-f39b1942422d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:04.714238 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2625aa3e-4053-414a-856d-f39b1942422d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:04.715064 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2625aa3e-4053-414a-856d-f39b1942422d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:04.715496 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2625aa3e-4053-414a-856d-f39b1942422d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:04.733164 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-2625aa3e-4053-414a-856d-f39b1942422d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Getting quotas for project 0076c4e65bce4bd58478d09d62607981. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:45:04.737192 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-2625aa3e-4053-414a-856d-f39b1942422d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Getting quotas for user d6589e2636dd46838a3a0c66d18e0d00 and project 0076c4e65bce4bd58478d09d62607981. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:45:04.795383 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2625aa3e-4053-414a-856d-f39b1942422d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Going to run 1 instances... {{(pid=124317) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 16:45:04.797462 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2625aa3e-4053-414a-856d-f39b1942422d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b5fdd553-03a2-4d3a-aa22-5754153aa64e',volume_size=None,volume_type=None)] {{(pid=124317) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 16:45:04.814061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4c13ef11-06b0-49f0-babf-9905d1a67892 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:04.822499 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4c13ef11-06b0-49f0-babf-9905d1a67892 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:04.824120 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4c13ef11-06b0-49f0-babf-9905d1a67892 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:04.825318 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4c13ef11-06b0-49f0-babf-9905d1a67892 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1406 microversion: 2.20 time: 0.167690 Jul 01 16:45:04.825950 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 301/592] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:45:04 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:45:04.928947 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2625aa3e-4053-414a-856d-f39b1942422d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.719142 Jul 01 16:45:04.929594 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 292/593] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 1 16:45:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 16:45:04.940784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3309a21f-39f9-481c-a42a-405bb049219e tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:04.941426 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3309a21f-39f9-481c-a42a-405bb049219e tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:04.995309 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3309a21f-39f9-481c-a42a-405bb049219e tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:05.001997 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3309a21f-39f9-481c-a42a-405bb049219e tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 200 len: 1094 microversion: 2.1 time: 0.064903 Jul 01 16:45:05.002465 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 302/594] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:04 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:05.844204 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b50c4136-177a-48b4-b97f-d4d0fce39990 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:05.844802 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b50c4136-177a-48b4-b97f-d4d0fce39990 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:05.851093 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b50c4136-177a-48b4-b97f-d4d0fce39990 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:05.851538 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b50c4136-177a-48b4-b97f-d4d0fce39990 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:05.852861 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b50c4136-177a-48b4-b97f-d4d0fce39990 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:05.853299 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b50c4136-177a-48b4-b97f-d4d0fce39990 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:05.986140 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b50c4136-177a-48b4-b97f-d4d0fce39990 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:05.996434 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b50c4136-177a-48b4-b97f-d4d0fce39990 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:05.998210 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b50c4136-177a-48b4-b97f-d4d0fce39990 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:05.999350 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b50c4136-177a-48b4-b97f-d4d0fce39990 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1406 microversion: 2.20 time: 0.159732 Jul 01 16:45:05.999903 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 293/595] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:45:05 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:45:06.019175 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6ac7c40d-4b85-4b4f-971c-0b633ac37280 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:06.019977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6ac7c40d-4b85-4b4f-971c-0b633ac37280 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:06.027507 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6ac7c40d-4b85-4b4f-971c-0b633ac37280 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:06.028051 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6ac7c40d-4b85-4b4f-971c-0b633ac37280 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:06.029124 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6ac7c40d-4b85-4b4f-971c-0b633ac37280 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:06.029641 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6ac7c40d-4b85-4b4f-971c-0b633ac37280 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:06.112422 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6ac7c40d-4b85-4b4f-971c-0b633ac37280 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:06.120633 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6ac7c40d-4b85-4b4f-971c-0b633ac37280 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 200 len: 1200 microversion: 2.1 time: 0.105488 Jul 01 16:45:06.121316 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 303/596] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:06 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 1200 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:07.018814 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-29b45904-7719-4b79-be77-9d965f6539a8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:07.020083 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-29b45904-7719-4b79-be77-9d965f6539a8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:07.027981 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-29b45904-7719-4b79-be77-9d965f6539a8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:07.028438 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-29b45904-7719-4b79-be77-9d965f6539a8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:07.029269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-29b45904-7719-4b79-be77-9d965f6539a8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:07.029741 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-29b45904-7719-4b79-be77-9d965f6539a8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:07.138288 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-aa4ad100-bed7-453d-9211-f8546eb7f237 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:07.138971 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-aa4ad100-bed7-453d-9211-f8546eb7f237 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:07.146761 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-aa4ad100-bed7-453d-9211-f8546eb7f237 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:07.147294 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-aa4ad100-bed7-453d-9211-f8546eb7f237 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:07.148131 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-aa4ad100-bed7-453d-9211-f8546eb7f237 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:07.148631 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-aa4ad100-bed7-453d-9211-f8546eb7f237 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:07.305050 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-29b45904-7719-4b79-be77-9d965f6539a8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:07.313068 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-29b45904-7719-4b79-be77-9d965f6539a8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:07.314605 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-29b45904-7719-4b79-be77-9d965f6539a8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:07.315709 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-29b45904-7719-4b79-be77-9d965f6539a8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1406 microversion: 2.20 time: 0.301194 Jul 01 16:45:07.316270 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 294/597] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:45:07 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1406 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:45:07.394653 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-aa4ad100-bed7-453d-9211-f8546eb7f237 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:07.403116 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-aa4ad100-bed7-453d-9211-f8546eb7f237 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 200 len: 1266 microversion: 2.1 time: 0.269537 Jul 01 16:45:07.403698 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 304/598] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:07 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:45:07.595840 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-60b7dbcc-0902-40f7-a4a0-b7b155648962 req-d53e8527-05cb-4357-959d-697dbe643e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d5cf19-9bb2-4534-8076-564fb7538cad", "name": "network-vif-plugged", "status": "completed", "tag": "ca06c719-80eb-4c4d-b8cd-b06d9b34ab88"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:07.608486 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-60b7dbcc-0902-40f7-a4a0-b7b155648962 req-d53e8527-05cb-4357-959d-697dbe643e77 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:07.608922 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-60b7dbcc-0902-40f7-a4a0-b7b155648962 req-d53e8527-05cb-4357-959d-697dbe643e77 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:07.622850 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-60b7dbcc-0902-40f7-a4a0-b7b155648962 req-d53e8527-05cb-4357-959d-697dbe643e77 service nova] Creating event network-vif-plugged:ca06c719-80eb-4c4d-b8cd-b06d9b34ab88 for instance d8d5cf19-9bb2-4534-8076-564fb7538cad on hv-cinder-79760 Jul 01 16:45:07.629157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-60b7dbcc-0902-40f7-a4a0-b7b155648962 req-d53e8527-05cb-4357-959d-697dbe643e77 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037915 Jul 01 16:45:07.630092 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 295/599] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:45:07.718122 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-97e37c9d-b6a6-4181-ae6c-128e4e270b60 req-382ced62-76a0-4107-bdde-2379fb3283cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33ee3ade-fd90-45c3-aa1c-d204a509deae", "tag": "7fb3f553-408e-4f22-af02-9d3d0efa9d93"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:07.726783 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-97e37c9d-b6a6-4181-ae6c-128e4e270b60 req-382ced62-76a0-4107-bdde-2379fb3283cb service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:07.727993 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-97e37c9d-b6a6-4181-ae6c-128e4e270b60 req-382ced62-76a0-4107-bdde-2379fb3283cb service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:07.741244 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-97e37c9d-b6a6-4181-ae6c-128e4e270b60 req-382ced62-76a0-4107-bdde-2379fb3283cb service nova] Creating event network-changed:7fb3f553-408e-4f22-af02-9d3d0efa9d93 for instance 33ee3ade-fd90-45c3-aa1c-d204a509deae on hv-cinder-79760 Jul 01 16:45:07.748553 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-97e37c9d-b6a6-4181-ae6c-128e4e270b60 req-382ced62-76a0-4107-bdde-2379fb3283cb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034083 Jul 01 16:45:07.749782 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 305/600] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:45:08.334843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-04b5db1e-fafa-41cb-aeca-51e6d9ccdf0f tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:08.335526 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-04b5db1e-fafa-41cb-aeca-51e6d9ccdf0f tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:08.342488 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-04b5db1e-fafa-41cb-aeca-51e6d9ccdf0f tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:08.342936 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-04b5db1e-fafa-41cb-aeca-51e6d9ccdf0f tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:08.343697 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-04b5db1e-fafa-41cb-aeca-51e6d9ccdf0f tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:08.344127 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-04b5db1e-fafa-41cb-aeca-51e6d9ccdf0f tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:08.421859 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ee7393aa-c8f6-4e37-b434-3a75c34fd140 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:08.422816 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ee7393aa-c8f6-4e37-b434-3a75c34fd140 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:08.424780 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:45:08.430930 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ee7393aa-c8f6-4e37-b434-3a75c34fd140 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:08.431416 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ee7393aa-c8f6-4e37-b434-3a75c34fd140 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:08.432197 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ee7393aa-c8f6-4e37-b434-3a75c34fd140 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:08.432636 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ee7393aa-c8f6-4e37-b434-3a75c34fd140 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:08.487824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-04b5db1e-fafa-41cb-aeca-51e6d9ccdf0f tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:08.497841 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-04b5db1e-fafa-41cb-aeca-51e6d9ccdf0f tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:08.499497 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-04b5db1e-fafa-41cb-aeca-51e6d9ccdf0f tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:08.500609 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-04b5db1e-fafa-41cb-aeca-51e6d9ccdf0f tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1406 microversion: 2.20 time: 0.170748 Jul 01 16:45:08.501176 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 296/601] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:45:08 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:45:08.581148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ee7393aa-c8f6-4e37-b434-3a75c34fd140 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:08.589204 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ee7393aa-c8f6-4e37-b434-3a75c34fd140 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 200 len: 1266 microversion: 2.1 time: 0.171929 Jul 01 16:45:08.589724 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 306/602] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:08 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:45:09.519167 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b3f9825c-8fde-4490-b3b0-8200352ced14 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:09.519765 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b3f9825c-8fde-4490-b3b0-8200352ced14 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:09.526472 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b3f9825c-8fde-4490-b3b0-8200352ced14 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:09.526912 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b3f9825c-8fde-4490-b3b0-8200352ced14 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:09.527661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b3f9825c-8fde-4490-b3b0-8200352ced14 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:09.528088 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b3f9825c-8fde-4490-b3b0-8200352ced14 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:09.606485 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9de72e8d-ecb8-4a55-baa4-cc2ed5c3bf87 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:09.607096 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9de72e8d-ecb8-4a55-baa4-cc2ed5c3bf87 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:09.613567 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9de72e8d-ecb8-4a55-baa4-cc2ed5c3bf87 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:09.614010 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9de72e8d-ecb8-4a55-baa4-cc2ed5c3bf87 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:09.614807 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9de72e8d-ecb8-4a55-baa4-cc2ed5c3bf87 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:09.615241 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9de72e8d-ecb8-4a55-baa4-cc2ed5c3bf87 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:09.793501 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b3f9825c-8fde-4490-b3b0-8200352ced14 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:09.801935 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b3f9825c-8fde-4490-b3b0-8200352ced14 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:09.803458 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b3f9825c-8fde-4490-b3b0-8200352ced14 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:09.804631 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b3f9825c-8fde-4490-b3b0-8200352ced14 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1406 microversion: 2.20 time: 0.289264 Jul 01 16:45:09.805821 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 297/603] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:45:09 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1406 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:45:09.876736 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9de72e8d-ecb8-4a55-baa4-cc2ed5c3bf87 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:09.885109 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9de72e8d-ecb8-4a55-baa4-cc2ed5c3bf87 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 200 len: 1266 microversion: 2.1 time: 0.283072 Jul 01 16:45:09.885696 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 307/604] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:09 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:10.823204 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7837239e-1ebf-466d-addd-903fe5fe0778 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:10.823812 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7837239e-1ebf-466d-addd-903fe5fe0778 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:10.830436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7837239e-1ebf-466d-addd-903fe5fe0778 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:10.830922 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7837239e-1ebf-466d-addd-903fe5fe0778 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:10.831685 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7837239e-1ebf-466d-addd-903fe5fe0778 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:10.832135 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7837239e-1ebf-466d-addd-903fe5fe0778 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:10.901805 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0d1b78b7-a6ad-4110-868f-44fda1c0023e tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:10.902458 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0d1b78b7-a6ad-4110-868f-44fda1c0023e tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:10.908891 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0d1b78b7-a6ad-4110-868f-44fda1c0023e tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:10.909345 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0d1b78b7-a6ad-4110-868f-44fda1c0023e tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:10.910120 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0d1b78b7-a6ad-4110-868f-44fda1c0023e tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:10.910591 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0d1b78b7-a6ad-4110-868f-44fda1c0023e tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:10.913157 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:45:10.996840 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7837239e-1ebf-466d-addd-903fe5fe0778 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:11.004961 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7837239e-1ebf-466d-addd-903fe5fe0778 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:11.006482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7837239e-1ebf-466d-addd-903fe5fe0778 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:11.007628 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7837239e-1ebf-466d-addd-903fe5fe0778 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1598 microversion: 2.20 time: 0.188375 Jul 01 16:45:11.008223 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 298/605] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:45:10 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1598 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:45:11.025935 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f1dd423d-cec2-4d20-a8d5-b99751e35ede tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:11.026581 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f1dd423d-cec2-4d20-a8d5-b99751e35ede tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:11.032690 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f1dd423d-cec2-4d20-a8d5-b99751e35ede tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:11.033149 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f1dd423d-cec2-4d20-a8d5-b99751e35ede tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:11.033911 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f1dd423d-cec2-4d20-a8d5-b99751e35ede tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:11.034366 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f1dd423d-cec2-4d20-a8d5-b99751e35ede tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:11.064932 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0d1b78b7-a6ad-4110-868f-44fda1c0023e tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:11.072596 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0d1b78b7-a6ad-4110-868f-44fda1c0023e tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 200 len: 1266 microversion: 2.1 time: 0.175386 Jul 01 16:45:11.073169 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 308/606] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:10 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:45:11.114218 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f1dd423d-cec2-4d20-a8d5-b99751e35ede tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093030 Jul 01 16:45:11.114862 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 299/607] 10.222.0.57 () {60 vars in 1315 bytes} [Fri Jul 1 16:45:11 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 16:45:12.090299 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d8b3f82e-4456-4872-8703-69abf921f065 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:12.090994 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d8b3f82e-4456-4872-8703-69abf921f065 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:12.097936 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d8b3f82e-4456-4872-8703-69abf921f065 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:12.098408 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d8b3f82e-4456-4872-8703-69abf921f065 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:12.099186 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d8b3f82e-4456-4872-8703-69abf921f065 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:12.099618 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d8b3f82e-4456-4872-8703-69abf921f065 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:12.322447 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d8b3f82e-4456-4872-8703-69abf921f065 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:12.329838 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d8b3f82e-4456-4872-8703-69abf921f065 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 200 len: 1266 microversion: 2.1 time: 0.243871 Jul 01 16:45:12.330439 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 309/608] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:12 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:12.373956 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-285dfa7b-fb44-44ff-bca3-e285c5b213b5 req-5bc9a12c-ed32-4dad-b4f9-24fa89f15cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8d5cf19-9bb2-4534-8076-564fb7538cad", "tag": "ca06c719-80eb-4c4d-b8cd-b06d9b34ab88"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:12.381781 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-285dfa7b-fb44-44ff-bca3-e285c5b213b5 req-5bc9a12c-ed32-4dad-b4f9-24fa89f15cdd service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:12.382223 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-285dfa7b-fb44-44ff-bca3-e285c5b213b5 req-5bc9a12c-ed32-4dad-b4f9-24fa89f15cdd service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:12.393820 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-285dfa7b-fb44-44ff-bca3-e285c5b213b5 req-5bc9a12c-ed32-4dad-b4f9-24fa89f15cdd service nova] Creating event network-changed:ca06c719-80eb-4c4d-b8cd-b06d9b34ab88 for instance d8d5cf19-9bb2-4534-8076-564fb7538cad on hv-cinder-79760 Jul 01 16:45:12.399202 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-285dfa7b-fb44-44ff-bca3-e285c5b213b5 req-5bc9a12c-ed32-4dad-b4f9-24fa89f15cdd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028682 Jul 01 16:45:12.399727 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 300/609] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:45:13.141231 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-af8a1436-0fff-485e-94d5-ad4b46ebeb35 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1885870418"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:13.141864 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-af8a1436-0fff-485e-94d5-ad4b46ebeb35 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:13.151055 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-af8a1436-0fff-485e-94d5-ad4b46ebeb35 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:13.151400 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-af8a1436-0fff-485e-94d5-ad4b46ebeb35 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:13.152172 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-af8a1436-0fff-485e-94d5-ad4b46ebeb35 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:13.152603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-af8a1436-0fff-485e-94d5-ad4b46ebeb35 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:13.293849 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.network.security_group_api [None req-af8a1436-0fff-485e-94d5-ad4b46ebeb35 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Removing security group dc4d8463-50b1-4283-a000-7cf20542b5c3 from port 74960809-e36c-4511-9a63-5f955f9a40f0 Jul 01 16:45:13.348447 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8c58f778-70ed-45d7-981b-4dfbecd8c15c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:13.349153 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8c58f778-70ed-45d7-981b-4dfbecd8c15c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:13.356554 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8c58f778-70ed-45d7-981b-4dfbecd8c15c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:13.357282 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8c58f778-70ed-45d7-981b-4dfbecd8c15c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:13.358242 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8c58f778-70ed-45d7-981b-4dfbecd8c15c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:13.358900 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8c58f778-70ed-45d7-981b-4dfbecd8c15c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:13.580673 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8c58f778-70ed-45d7-981b-4dfbecd8c15c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:13.589156 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8c58f778-70ed-45d7-981b-4dfbecd8c15c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 200 len: 1266 microversion: 2.1 time: 0.244992 Jul 01 16:45:13.589764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 301/610] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:13 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:13.740771 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-af8a1436-0fff-485e-94d5-ad4b46ebeb35 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "POST /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913/action" status: 202 len: 0 microversion: 2.1 time: 0.603520 Jul 01 16:45:13.741495 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 310/611] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 1 16:45:13 2022] POST /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913/action => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:45:14.414631 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-db2dd365-a133-441f-9c08-30d8d8d7ca80 req-7fa82b61-3be8-43cc-a085-4f702cc71d76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74fca065-c0ba-4a16-958e-a991e16bb913", "tag": "74960809-e36c-4511-9a63-5f955f9a40f0"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:14.424049 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-db2dd365-a133-441f-9c08-30d8d8d7ca80 req-7fa82b61-3be8-43cc-a085-4f702cc71d76 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:14.424488 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-db2dd365-a133-441f-9c08-30d8d8d7ca80 req-7fa82b61-3be8-43cc-a085-4f702cc71d76 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:14.436877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-db2dd365-a133-441f-9c08-30d8d8d7ca80 req-7fa82b61-3be8-43cc-a085-4f702cc71d76 service nova] Creating event network-changed:74960809-e36c-4511-9a63-5f955f9a40f0 for instance 74fca065-c0ba-4a16-958e-a991e16bb913 on hv-cinder-79760 Jul 01 16:45:14.442127 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-db2dd365-a133-441f-9c08-30d8d8d7ca80 req-7fa82b61-3be8-43cc-a085-4f702cc71d76 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031486 Jul 01 16:45:14.442770 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 302/612] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:45:14.607785 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-7d494aec-b0c6-4f4c-ae43-7b6e1d737247 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:14.608402 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-7d494aec-b0c6-4f4c-ae43-7b6e1d737247 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:14.614475 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7d494aec-b0c6-4f4c-ae43-7b6e1d737247 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:14.614923 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7d494aec-b0c6-4f4c-ae43-7b6e1d737247 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:14.615693 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7d494aec-b0c6-4f4c-ae43-7b6e1d737247 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:14.616128 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7d494aec-b0c6-4f4c-ae43-7b6e1d737247 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:14.953641 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7d494aec-b0c6-4f4c-ae43-7b6e1d737247 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:14.962641 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-7d494aec-b0c6-4f4c-ae43-7b6e1d737247 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 200 len: 1266 microversion: 2.1 time: 0.359312 Jul 01 16:45:14.963006 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 311/613] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:14 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 1266 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:15.384588 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=4 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:45:15.385292 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=12 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:45:15.389678 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-31cd7ba8-4472-4e04-b43e-4fd694ce1fde tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:15.390248 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-31cd7ba8-4472-4e04-b43e-4fd694ce1fde tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:15.397645 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-31cd7ba8-4472-4e04-b43e-4fd694ce1fde tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:15.398086 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-31cd7ba8-4472-4e04-b43e-4fd694ce1fde tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:15.399233 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-31cd7ba8-4472-4e04-b43e-4fd694ce1fde tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:15.399749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-31cd7ba8-4472-4e04-b43e-4fd694ce1fde tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:15.484267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-31cd7ba8-4472-4e04-b43e-4fd694ce1fde tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lazy-loading 'services' on Instance uuid 74fca065-c0ba-4a16-958e-a991e16bb913 {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:45:15.561701 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-31cd7ba8-4472-4e04-b43e-4fd694ce1fde tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "DELETE /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913/os-volume_attachments/7f820122-863d-4db8-81b7-77c3be6c8111" status: 202 len: 0 microversion: 2.1 time: 0.178373 Jul 01 16:45:15.562458 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 303/614] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 1 16:45:15 2022] DELETE /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913/os-volume_attachments/7f820122-863d-4db8-81b7-77c3be6c8111 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:45:15.571398 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2f4c6e16-9796-4f5c-9869-9647e800599a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:15.572301 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2f4c6e16-9796-4f5c-9869-9647e800599a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:15.574135 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=8 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:45:15.580120 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2f4c6e16-9796-4f5c-9869-9647e800599a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:15.580696 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2f4c6e16-9796-4f5c-9869-9647e800599a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:15.581527 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2f4c6e16-9796-4f5c-9869-9647e800599a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:15.581964 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2f4c6e16-9796-4f5c-9869-9647e800599a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:15.611583 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2f4c6e16-9796-4f5c-9869-9647e800599a tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044907 Jul 01 16:45:15.615517 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 312/615] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 1 16:45:15 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:45:15.980132 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4be812f7-5872-4172-96a8-cc89ac85c3e3 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:15.980760 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4be812f7-5872-4172-96a8-cc89ac85c3e3 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:15.987123 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4be812f7-5872-4172-96a8-cc89ac85c3e3 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:15.987585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4be812f7-5872-4172-96a8-cc89ac85c3e3 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:15.988355 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4be812f7-5872-4172-96a8-cc89ac85c3e3 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:15.988795 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4be812f7-5872-4172-96a8-cc89ac85c3e3 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:16.128017 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4be812f7-5872-4172-96a8-cc89ac85c3e3 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:16.136782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4be812f7-5872-4172-96a8-cc89ac85c3e3 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 200 len: 1266 microversion: 2.1 time: 0.160998 Jul 01 16:45:16.137552 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 304/616] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:15 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:16.457244 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-10dd2835-c693-4729-8a94-4b86d5bf84b9 req-f8798579-6bcf-4d95-8f9b-55c0f7a5a4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74fca065-c0ba-4a16-958e-a991e16bb913", "tag": "74960809-e36c-4511-9a63-5f955f9a40f0"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:16.465647 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-10dd2835-c693-4729-8a94-4b86d5bf84b9 req-f8798579-6bcf-4d95-8f9b-55c0f7a5a4b6 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:16.466087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-10dd2835-c693-4729-8a94-4b86d5bf84b9 req-f8798579-6bcf-4d95-8f9b-55c0f7a5a4b6 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:16.477405 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-10dd2835-c693-4729-8a94-4b86d5bf84b9 req-f8798579-6bcf-4d95-8f9b-55c0f7a5a4b6 service nova] Creating event network-changed:74960809-e36c-4511-9a63-5f955f9a40f0 for instance 74fca065-c0ba-4a16-958e-a991e16bb913 on hv-cinder-79760 Jul 01 16:45:16.482468 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-10dd2835-c693-4729-8a94-4b86d5bf84b9 req-f8798579-6bcf-4d95-8f9b-55c0f7a5a4b6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028916 Jul 01 16:45:16.483048 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 313/617] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:45:16.624125 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b558a762-0086-4981-a19e-f7024b7a4ced tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:16.625201 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b558a762-0086-4981-a19e-f7024b7a4ced tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:16.632303 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b558a762-0086-4981-a19e-f7024b7a4ced tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:16.632785 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b558a762-0086-4981-a19e-f7024b7a4ced tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:16.633596 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b558a762-0086-4981-a19e-f7024b7a4ced tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:16.634028 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b558a762-0086-4981-a19e-f7024b7a4ced tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:16.657733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:45:16.662417 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b558a762-0086-4981-a19e-f7024b7a4ced tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042526 Jul 01 16:45:16.662972 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 305/618] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 1 16:45:16 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:45:17.155621 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-08c5a07a-500e-4f98-a477-6a3e4c75cde1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:17.156349 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-08c5a07a-500e-4f98-a477-6a3e4c75cde1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:17.162745 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-08c5a07a-500e-4f98-a477-6a3e4c75cde1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:17.163280 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-08c5a07a-500e-4f98-a477-6a3e4c75cde1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:17.164697 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-08c5a07a-500e-4f98-a477-6a3e4c75cde1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:17.164697 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-08c5a07a-500e-4f98-a477-6a3e4c75cde1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:17.481271 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-08c5a07a-500e-4f98-a477-6a3e4c75cde1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:17.489023 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-08c5a07a-500e-4f98-a477-6a3e4c75cde1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 200 len: 1266 microversion: 2.1 time: 0.338200 Jul 01 16:45:17.489596 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 314/619] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:17 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:17.675046 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-aeb60da6-96d5-45a0-a754-e2bd34a73fe0 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:17.676117 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-aeb60da6-96d5-45a0-a754-e2bd34a73fe0 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:17.685223 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aeb60da6-96d5-45a0-a754-e2bd34a73fe0 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:17.685668 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aeb60da6-96d5-45a0-a754-e2bd34a73fe0 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:17.686472 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aeb60da6-96d5-45a0-a754-e2bd34a73fe0 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:17.686912 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aeb60da6-96d5-45a0-a754-e2bd34a73fe0 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:17.716850 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-aeb60da6-96d5-45a0-a754-e2bd34a73fe0 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045774 Jul 01 16:45:17.717411 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 306/620] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 1 16:45:17 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 16:45:17.728176 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-44e17bc9-39d1-488e-8502-770a24fd017e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:17.728682 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-44e17bc9-39d1-488e-8502-770a24fd017e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:17.734916 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-44e17bc9-39d1-488e-8502-770a24fd017e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:17.735358 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-44e17bc9-39d1-488e-8502-770a24fd017e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:17.736207 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-44e17bc9-39d1-488e-8502-770a24fd017e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:17.736626 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-44e17bc9-39d1-488e-8502-770a24fd017e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:17.809733 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-44e17bc9-39d1-488e-8502-770a24fd017e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] HTTP exception thrown: Instance 74fca065-c0ba-4a16-958e-a991e16bb913 is not attached to volume 7f820122-863d-4db8-81b7-77c3be6c8111 Jul 01 16:45:17.820548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-44e17bc9-39d1-488e-8502-770a24fd017e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Request method failure captured: Jul 01 16:45:17.820548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: DELETE /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913/os-volume_attachments/7f820122-863d-4db8-81b7-77c3be6c8111 HTTP/1.1 Jul 01 16:45:17.820548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:45:17.820548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:45:17.820548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:45:17.820548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:45:17.820548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:45:17.820548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:45:17.820548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:45:17.820548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:45:17.820548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyO7qSZjqcaqpiJdC2z8oJ6nf2-l3GM_IGD6mMJVEJwlyYdHSeYBq5ih2kDJ6dG-WnONF7CMMYdiO2ovkBQPWMQ6nwRji6e-7dkeuc0qjQfcmCt8OklN6p6tUdkNwp0xc5uUnYmvIVy-sLL6pJm4sR8iKFFs3vwItLj5ui2i4XZrWqM Jul 01 16:45:17.820548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:45:17.820548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:45:17.820548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:45:17.820548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:45:17.820548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:45:17.820548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:45:17.820548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: ef0cc672766c47759a088a398d95147f Jul 01 16:45:17.820548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-TestMinimumBasicScenario-799660347 Jul 01 16:45:17.820548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:45:17.820548 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:45:17.822277 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ef0cc672766c47759a088a398d95147f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ef0cc672766c47759a088a398d95147f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ef0cc672766c47759a088a398d95147f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ef0cc672766c47759a088a398d95147f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:45:17.822277 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-TestMinimumBasicScenario-799660347 Jul 01 16:45:17.822277 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: ef0cc672766c47759a088a398d95147f Jul 01 16:45:17.822277 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-TestMinimumBasicScenario-799660347 Jul 01 16:45:17.822277 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-TestMinimumBasicScenario-799660347-project Jul 01 16:45:17.822277 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:45:17.822277 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:45:17.822277 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: c1ab0b52325c4ab387db034eb7dfcadb Jul 01 16:45:17.822277 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-TestMinimumBasicScenario-799660347-project Jul 01 16:45:17.822277 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: > Jul 01 16:45:17.822277 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Instance 74fca065-c0ba-4a16-958e-a991e16bb913 is not attached to volume 7f820122-863d-4db8-81b7-77c3be6c8111 Jul 01 16:45:17.823080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'server_id': '74fca065-c0ba-4a16-958e-a991e16bb913', 'id': '7f820122-863d-4db8-81b7-77c3be6c8111'} Jul 01 16:45:17.823080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:45:17.823080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:45:17.823080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 01 16:45:17.823080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 01 16:45:17.823080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 16:45:17.823080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 16:45:17.823080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 01 16:45:17.823080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 01 16:45:17.823080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7f820122-863d-4db8-81b7-77c3be6c8111. Jul 01 16:45:17.823080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:45:17.823080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:45:17.823080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:45:17.823080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:45:17.823080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:45:17.823080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:45:17.823080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:45:17.823080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:45:17.823080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:45:17.824281 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:45:17.824281 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 01 16:45:17.824281 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 01 16:45:17.824281 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74fca065-c0ba-4a16-958e-a991e16bb913 is not attached to volume 7f820122-863d-4db8-81b7-77c3be6c8111 Jul 01 16:45:17.824281 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:45:17.824281 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:45:17.824281 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:45:17.824281 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:45:17.824281 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:45:17.824281 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:45:17.824281 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:45:17.824281 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:45:17.824281 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74fca065-c0ba-4a16-958e-a991e16bb913 is not attached to volume 7f820122-863d-4db8-81b7-77c3be6c8111 Jul 01 16:45:17.824281 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:45:17.824281 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-44e17bc9-39d1-488e-8502-770a24fd017e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Returning 404 to user: Instance 74fca065-c0ba-4a16-958e-a991e16bb913 is not attached to volume 7f820122-863d-4db8-81b7-77c3be6c8111 {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:45:17.825277 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-44e17bc9-39d1-488e-8502-770a24fd017e tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "DELETE /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913/os-volume_attachments/7f820122-863d-4db8-81b7-77c3be6c8111" status: 404 len: 154 microversion: 2.1 time: 0.098563 Jul 01 16:45:17.825277 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 315/621] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 1 16:45:17 2022] DELETE /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913/os-volume_attachments/7f820122-863d-4db8-81b7-77c3be6c8111 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:45:18.506469 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2c82202c-b982-47cf-b95e-08a4e9e209b8 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:18.507076 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2c82202c-b982-47cf-b95e-08a4e9e209b8 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:18.513780 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2c82202c-b982-47cf-b95e-08a4e9e209b8 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:18.514234 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2c82202c-b982-47cf-b95e-08a4e9e209b8 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:18.515045 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2c82202c-b982-47cf-b95e-08a4e9e209b8 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:18.515736 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2c82202c-b982-47cf-b95e-08a4e9e209b8 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:18.653392 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2c82202c-b982-47cf-b95e-08a4e9e209b8 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:18.660861 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2c82202c-b982-47cf-b95e-08a4e9e209b8 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 200 len: 1266 microversion: 2.1 time: 0.158301 Jul 01 16:45:18.661427 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 307/622] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:18 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:18.886670 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b2fb7af5-7f6d-400d-b14a-c23153be6bcf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:18.887229 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b2fb7af5-7f6d-400d-b14a-c23153be6bcf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:18.893310 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b2fb7af5-7f6d-400d-b14a-c23153be6bcf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:18.893753 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b2fb7af5-7f6d-400d-b14a-c23153be6bcf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:18.894536 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b2fb7af5-7f6d-400d-b14a-c23153be6bcf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:18.894965 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b2fb7af5-7f6d-400d-b14a-c23153be6bcf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:18.918020 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b2fb7af5-7f6d-400d-b14a-c23153be6bcf tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d/ips" status: 200 len: 150 microversion: 2.1 time: 0.035876 Jul 01 16:45:18.918644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 316/623] 10.222.0.57 () {58 vars in 1247 bytes} [Fri Jul 1 16:45:18 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:45:18.959083 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-af149903-fdfe-481e-9d99-73742b24f6f9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:18.959555 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-af149903-fdfe-481e-9d99-73742b24f6f9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:18.966759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-af149903-fdfe-481e-9d99-73742b24f6f9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:18.967202 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-af149903-fdfe-481e-9d99-73742b24f6f9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:18.967957 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-af149903-fdfe-481e-9d99-73742b24f6f9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:18.968383 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-af149903-fdfe-481e-9d99-73742b24f6f9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:18.994588 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-af149903-fdfe-481e-9d99-73742b24f6f9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Going to try to terminate instance {{(pid=124317) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 16:45:19.097257 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-af149903-fdfe-481e-9d99-73742b24f6f9 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "DELETE /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 204 len: 0 microversion: 2.1 time: 0.141905 Jul 01 16:45:19.097847 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 308/624] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:45:18 2022] DELETE /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 16:45:19.107258 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cca31e48-d3e1-4840-bd7b-dae279e27bd8 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:19.107913 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-cca31e48-d3e1-4840-bd7b-dae279e27bd8 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:19.114036 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cca31e48-d3e1-4840-bd7b-dae279e27bd8 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:19.114495 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cca31e48-d3e1-4840-bd7b-dae279e27bd8 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:19.115940 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cca31e48-d3e1-4840-bd7b-dae279e27bd8 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:19.116443 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cca31e48-d3e1-4840-bd7b-dae279e27bd8 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:19.291175 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-cca31e48-d3e1-4840-bd7b-dae279e27bd8 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:19.299299 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-cca31e48-d3e1-4840-bd7b-dae279e27bd8 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1554 microversion: 2.1 time: 0.196291 Jul 01 16:45:19.299852 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 317/625] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:19 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1554 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:45:19.623011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-512754ac-1015-4262-8500-022bda60fd04 req-13af9de5-65a9-49f4-98df-9ccd328ade0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33ee3ade-fd90-45c3-aa1c-d204a509deae", "name": "network-vif-plugged", "status": "completed", "tag": "7fb3f553-408e-4f22-af02-9d3d0efa9d93"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:19.633360 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-512754ac-1015-4262-8500-022bda60fd04 req-13af9de5-65a9-49f4-98df-9ccd328ade0d service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:19.633871 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-512754ac-1015-4262-8500-022bda60fd04 req-13af9de5-65a9-49f4-98df-9ccd328ade0d service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:19.645558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-512754ac-1015-4262-8500-022bda60fd04 req-13af9de5-65a9-49f4-98df-9ccd328ade0d service nova] Creating event network-vif-plugged:7fb3f553-408e-4f22-af02-9d3d0efa9d93 for instance 33ee3ade-fd90-45c3-aa1c-d204a509deae on hv-cinder-79760 Jul 01 16:45:19.650642 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-512754ac-1015-4262-8500-022bda60fd04 req-13af9de5-65a9-49f4-98df-9ccd328ade0d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033569 Jul 01 16:45:19.651240 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 309/626] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:45:19.678080 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f0345e9c-6723-466d-8342-67395d2daed5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:19.678772 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f0345e9c-6723-466d-8342-67395d2daed5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:19.685876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f0345e9c-6723-466d-8342-67395d2daed5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:19.686272 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f0345e9c-6723-466d-8342-67395d2daed5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:19.687330 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f0345e9c-6723-466d-8342-67395d2daed5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:19.687751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f0345e9c-6723-466d-8342-67395d2daed5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:19.821596 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f0345e9c-6723-466d-8342-67395d2daed5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:19.829050 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f0345e9c-6723-466d-8342-67395d2daed5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 200 len: 1266 microversion: 2.1 time: 0.155125 Jul 01 16:45:19.829622 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 318/627] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:19 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:20.263460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f0b5bcfb-c49a-47c0-bdce-fe2fa5e96a14 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50fca0df-10f4-4219-b39b-08b2c23912e1"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:20.264593 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f0b5bcfb-c49a-47c0-bdce-fe2fa5e96a14 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:20.270811 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f0b5bcfb-c49a-47c0-bdce-fe2fa5e96a14 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:20.271260 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f0b5bcfb-c49a-47c0-bdce-fe2fa5e96a14 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:20.272012 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f0b5bcfb-c49a-47c0-bdce-fe2fa5e96a14 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:20.272444 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f0b5bcfb-c49a-47c0-bdce-fe2fa5e96a14 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:20.316773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-26115805-2a19-445f-9a57-7d55c3aa9968 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:20.317392 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-26115805-2a19-445f-9a57-7d55c3aa9968 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:20.328631 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-26115805-2a19-445f-9a57-7d55c3aa9968 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:20.329091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-26115805-2a19-445f-9a57-7d55c3aa9968 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:20.329887 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-26115805-2a19-445f-9a57-7d55c3aa9968 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:20.330331 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-26115805-2a19-445f-9a57-7d55c3aa9968 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:20.473512 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-26115805-2a19-445f-9a57-7d55c3aa9968 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:20.481614 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-26115805-2a19-445f-9a57-7d55c3aa9968 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1554 microversion: 2.1 time: 0.168631 Jul 01 16:45:20.482188 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 319/628] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:20 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:45:20.847536 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-46320f5e-9f2d-4912-a5f8-77cd4308f946 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:20.848152 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-46320f5e-9f2d-4912-a5f8-77cd4308f946 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:20.854953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-46320f5e-9f2d-4912-a5f8-77cd4308f946 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:20.855408 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-46320f5e-9f2d-4912-a5f8-77cd4308f946 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:20.856363 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-46320f5e-9f2d-4912-a5f8-77cd4308f946 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:20.856687 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-46320f5e-9f2d-4912-a5f8-77cd4308f946 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:20.994218 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-46320f5e-9f2d-4912-a5f8-77cd4308f946 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:21.001615 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-46320f5e-9f2d-4912-a5f8-77cd4308f946 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 200 len: 1266 microversion: 2.1 time: 0.157939 Jul 01 16:45:21.002176 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 320/629] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:20 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:45:21.498395 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1af49fb5-0bde-4bde-b253-ba5095bdc0b5 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:21.499134 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1af49fb5-0bde-4bde-b253-ba5095bdc0b5 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:21.506262 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1af49fb5-0bde-4bde-b253-ba5095bdc0b5 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:21.506837 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1af49fb5-0bde-4bde-b253-ba5095bdc0b5 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:21.507648 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1af49fb5-0bde-4bde-b253-ba5095bdc0b5 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:21.508930 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1af49fb5-0bde-4bde-b253-ba5095bdc0b5 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:21.535019 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f0b5bcfb-c49a-47c0-bdce-fe2fa5e96a14 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "POST /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.277117 Jul 01 16:45:21.535625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 310/630] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 1 16:45:20 2022] POST /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d/os-volume_attachments => generated 194 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:45:21.652559 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-1af49fb5-0bde-4bde-b253-ba5095bdc0b5 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:21.659918 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1af49fb5-0bde-4bde-b253-ba5095bdc0b5 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1554 microversion: 2.1 time: 0.165510 Jul 01 16:45:21.660480 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 321/631] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:21 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:45:22.020282 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4135461e-9c51-4546-9f00-9b5953395720 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:22.020893 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4135461e-9c51-4546-9f00-9b5953395720 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:22.027123 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4135461e-9c51-4546-9f00-9b5953395720 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:22.027571 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4135461e-9c51-4546-9f00-9b5953395720 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:22.028712 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4135461e-9c51-4546-9f00-9b5953395720 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:22.028860 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4135461e-9c51-4546-9f00-9b5953395720 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:22.171143 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-46260cfb-4b03-4bfe-b6eb-2e61acc613a9 req-de7cba90-9081-4a4e-bcbf-0b99b95043af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74fca065-c0ba-4a16-958e-a991e16bb913", "name": "network-vif-deleted", "tag": "74960809-e36c-4511-9a63-5f955f9a40f0"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:22.179127 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-46260cfb-4b03-4bfe-b6eb-2e61acc613a9 req-de7cba90-9081-4a4e-bcbf-0b99b95043af service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:22.180575 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-46260cfb-4b03-4bfe-b6eb-2e61acc613a9 req-de7cba90-9081-4a4e-bcbf-0b99b95043af service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:22.191848 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-46260cfb-4b03-4bfe-b6eb-2e61acc613a9 req-de7cba90-9081-4a4e-bcbf-0b99b95043af service nova] Creating event network-vif-deleted:74960809-e36c-4511-9a63-5f955f9a40f0 for instance 74fca065-c0ba-4a16-958e-a991e16bb913 on hv-cinder-79760 Jul 01 16:45:22.197761 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-46260cfb-4b03-4bfe-b6eb-2e61acc613a9 req-de7cba90-9081-4a4e-bcbf-0b99b95043af service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030141 Jul 01 16:45:22.198488 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 322/632] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:45:22.217355 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4135461e-9c51-4546-9f00-9b5953395720 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:22.225336 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4135461e-9c51-4546-9f00-9b5953395720 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 200 len: 1266 microversion: 2.1 time: 0.209748 Jul 01 16:45:22.226144 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 311/633] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:22 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:22.678191 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-11224f95-068f-42f2-bc03-0969319c85ea tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:22.678809 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-11224f95-068f-42f2-bc03-0969319c85ea tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:22.686075 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-11224f95-068f-42f2-bc03-0969319c85ea tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:22.686564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-11224f95-068f-42f2-bc03-0969319c85ea tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:22.687353 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-11224f95-068f-42f2-bc03-0969319c85ea tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:22.687796 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-11224f95-068f-42f2-bc03-0969319c85ea tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:22.760416 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-11224f95-068f-42f2-bc03-0969319c85ea tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:22.767929 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-11224f95-068f-42f2-bc03-0969319c85ea tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1343 microversion: 2.1 time: 0.094665 Jul 01 16:45:22.768503 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 323/634] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:22 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1343 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:23.243734 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-854ca5cd-f3d4-4e1f-875d-ae290e13c053 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:23.244336 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-854ca5cd-f3d4-4e1f-875d-ae290e13c053 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:23.250772 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-854ca5cd-f3d4-4e1f-875d-ae290e13c053 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:23.251202 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-854ca5cd-f3d4-4e1f-875d-ae290e13c053 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:23.251951 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-854ca5cd-f3d4-4e1f-875d-ae290e13c053 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:23.252392 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-854ca5cd-f3d4-4e1f-875d-ae290e13c053 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:23.396638 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-854ca5cd-f3d4-4e1f-875d-ae290e13c053 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:23.404222 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-854ca5cd-f3d4-4e1f-875d-ae290e13c053 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 200 len: 1266 microversion: 2.1 time: 0.165162 Jul 01 16:45:23.404806 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 312/635] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:23 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:23.784900 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a1d1b3e1-e173-4b7d-baef-b943ed5be4f3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:23.785519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a1d1b3e1-e173-4b7d-baef-b943ed5be4f3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:23.793204 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a1d1b3e1-e173-4b7d-baef-b943ed5be4f3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:23.793655 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a1d1b3e1-e173-4b7d-baef-b943ed5be4f3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:23.794578 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a1d1b3e1-e173-4b7d-baef-b943ed5be4f3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:23.795019 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a1d1b3e1-e173-4b7d-baef-b943ed5be4f3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:23.825514 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a1d1b3e1-e173-4b7d-baef-b943ed5be4f3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:23.825893 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a1d1b3e1-e173-4b7d-baef-b943ed5be4f3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:23.826374 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-a1d1b3e1-e173-4b7d-baef-b943ed5be4f3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lazy-loading 'fault' on Instance uuid 74fca065-c0ba-4a16-958e-a991e16bb913 {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:45:23.868288 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a1d1b3e1-e173-4b7d-baef-b943ed5be4f3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab0b52325c4ab387db034eb7dfcadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0cc672766c47759a088a398d95147f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:23.875743 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a1d1b3e1-e173-4b7d-baef-b943ed5be4f3 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 200 len: 1348 microversion: 2.1 time: 0.094630 Jul 01 16:45:23.876301 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 324/636] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:23 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 1348 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:24.422905 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-21315728-5db9-4aa5-9eb3-e0023b69c3af tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:24.424123 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-21315728-5db9-4aa5-9eb3-e0023b69c3af tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:24.431821 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-21315728-5db9-4aa5-9eb3-e0023b69c3af tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:24.431821 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-21315728-5db9-4aa5-9eb3-e0023b69c3af tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:24.432502 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-21315728-5db9-4aa5-9eb3-e0023b69c3af tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:24.432937 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-21315728-5db9-4aa5-9eb3-e0023b69c3af tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:24.630952 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-21315728-5db9-4aa5-9eb3-e0023b69c3af tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:24.639504 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-21315728-5db9-4aa5-9eb3-e0023b69c3af tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 200 len: 1453 microversion: 2.1 time: 0.221613 Jul 01 16:45:24.640096 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 313/637] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:24 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 1453 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:45:24.656378 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9da954a5-e5e6-4268-9548-07ddc80ca87a tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:24.656985 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9da954a5-e5e6-4268-9548-07ddc80ca87a tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:24.662845 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9da954a5-e5e6-4268-9548-07ddc80ca87a tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:24.663287 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9da954a5-e5e6-4268-9548-07ddc80ca87a tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:24.664757 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9da954a5-e5e6-4268-9548-07ddc80ca87a tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:24.665106 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9da954a5-e5e6-4268-9548-07ddc80ca87a tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:24.892979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-894fdc44-d3f1-444b-86a9-e31d59241c75 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:24.893915 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-894fdc44-d3f1-444b-86a9-e31d59241c75 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] [instance: 74fca065-c0ba-4a16-958e-a991e16bb913] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:24.900020 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-894fdc44-d3f1-444b-86a9-e31d59241c75 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:24.900545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-894fdc44-d3f1-444b-86a9-e31d59241c75 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:24.901385 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-894fdc44-d3f1-444b-86a9-e31d59241c75 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:24.901920 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-894fdc44-d3f1-444b-86a9-e31d59241c75 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:24.902653 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9da954a5-e5e6-4268-9548-07ddc80ca87a tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:24.910566 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9da954a5-e5e6-4268-9548-07ddc80ca87a tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 200 len: 1453 microversion: 2.1 time: 0.257816 Jul 01 16:45:24.911139 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 325/638] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:24 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 1453 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:24.924095 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-894fdc44-d3f1-444b-86a9-e31d59241c75 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] HTTP exception thrown: Instance 74fca065-c0ba-4a16-958e-a991e16bb913 could not be found. Jul 01 16:45:24.925730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-894fdc44-d3f1-444b-86a9-e31d59241c75 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Request method failure captured: Jul 01 16:45:24.925730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 HTTP/1.1 Jul 01 16:45:24.925730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:45:24.925730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:45:24.925730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:45:24.925730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:45:24.925730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:45:24.925730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:45:24.925730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:45:24.925730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:45:24.925730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyO7qSZjqcaqpiJdC2z8oJ6nf2-l3GM_IGD6mMJVEJwlyYdHSeYBq5ih2kDJ6dG-WnONF7CMMYdiO2ovkBQPWMQ6nwRji6e-7dkeuc0qjQfcmCt8OklN6p6tUdkNwp0xc5uUnYmvIVy-sLL6pJm4sR8iKFFs3vwItLj5ui2i4XZrWqM Jul 01 16:45:24.925730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:45:24.925730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:45:24.925730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:45:24.925730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:45:24.925730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:45:24.925730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:45:24.925730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: ef0cc672766c47759a088a398d95147f Jul 01 16:45:24.925730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-TestMinimumBasicScenario-799660347 Jul 01 16:45:24.925730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:45:24.925730 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:45:24.927045 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ef0cc672766c47759a088a398d95147f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ef0cc672766c47759a088a398d95147f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ef0cc672766c47759a088a398d95147f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ef0cc672766c47759a088a398d95147f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:45:24.927045 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-TestMinimumBasicScenario-799660347 Jul 01 16:45:24.927045 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: ef0cc672766c47759a088a398d95147f Jul 01 16:45:24.927045 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-TestMinimumBasicScenario-799660347 Jul 01 16:45:24.927045 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-TestMinimumBasicScenario-799660347-project Jul 01 16:45:24.927045 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:45:24.927045 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:45:24.927045 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: c1ab0b52325c4ab387db034eb7dfcadb Jul 01 16:45:24.927045 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-TestMinimumBasicScenario-799660347-project Jul 01 16:45:24.927045 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:45:24.927045 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance 74fca065-c0ba-4a16-958e-a991e16bb913 could not be found. Jul 01 16:45:24.927045 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': '74fca065-c0ba-4a16-958e-a991e16bb913'} Jul 01 16:45:24.927801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:45:24.927801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:45:24.927801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:45:24.927801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:45:24.927801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:45:24.927801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:45:24.927801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:45:24.927801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:45:24.927801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:45:24.927801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:45:24.927801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74fca065-c0ba-4a16-958e-a991e16bb913 could not be found. Jul 01 16:45:24.927801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:24.927801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:45:24.927801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:24.927801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:45:24.927801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:45:24.927801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:45:24.927801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:45:24.927801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:45:24.927801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:45:24.930267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:45:24.930267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:45:24.930267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:45:24.930267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:45:24.930267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:45:24.930267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:45:24.930267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:45:24.930267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74fca065-c0ba-4a16-958e-a991e16bb913 could not be found. Jul 01 16:45:24.930267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:24.930267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:45:24.930267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:24.930267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:45:24.930267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:45:24.930267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:45:24.930267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:45:24.930267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:45:24.930267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74fca065-c0ba-4a16-958e-a991e16bb913 could not be found. Jul 01 16:45:24.930267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:24.932466 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-894fdc44-d3f1-444b-86a9-e31d59241c75 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Returning 404 to user: Instance 74fca065-c0ba-4a16-958e-a991e16bb913 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:45:24.932466 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-894fdc44-d3f1-444b-86a9-e31d59241c75 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913" status: 404 len: 111 microversion: 2.1 time: 0.038086 Jul 01 16:45:24.932466 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 314/639] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:24 2022] GET /compute/v2.1/servers/74fca065-c0ba-4a16-958e-a991e16bb913 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 16:45:24.936728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-157c9ceb-8ff2-49cd-9698-b097b917e6d1 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] Calling method '.version_select at 0x7fa85f2b5670>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:24.956242 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-157c9ceb-8ff2-49cd-9698-b097b917e6d1 tempest-TestMinimumBasicScenario-799660347 tempest-TestMinimumBasicScenario-799660347-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1408550488" status: 202 len: 0 microversion: 2.1 time: 0.023262 Jul 01 16:45:24.956963 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 326/640] 10.222.0.57 () {58 vars in 1271 bytes} [Fri Jul 1 16:45:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1408550488 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:45:27.791369 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-6b6cb107-cbf5-4605-8806-29cd495b22f7 req-56f19d98-ce9c-44bb-aa2c-7f7170c043c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33ee3ade-fd90-45c3-aa1c-d204a509deae", "tag": "7fb3f553-408e-4f22-af02-9d3d0efa9d93"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:27.801283 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-6b6cb107-cbf5-4605-8806-29cd495b22f7 req-56f19d98-ce9c-44bb-aa2c-7f7170c043c9 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:27.801939 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-6b6cb107-cbf5-4605-8806-29cd495b22f7 req-56f19d98-ce9c-44bb-aa2c-7f7170c043c9 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:27.816101 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-6b6cb107-cbf5-4605-8806-29cd495b22f7 req-56f19d98-ce9c-44bb-aa2c-7f7170c043c9 service nova] Creating event network-changed:7fb3f553-408e-4f22-af02-9d3d0efa9d93 for instance 33ee3ade-fd90-45c3-aa1c-d204a509deae on hv-cinder-79760 Jul 01 16:45:27.822236 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-6b6cb107-cbf5-4605-8806-29cd495b22f7 req-56f19d98-ce9c-44bb-aa2c-7f7170c043c9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035590 Jul 01 16:45:27.822858 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 315/641] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:45:31.275534 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2ff3ea44-2d37-4aad-98aa-fe0a879f880d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50fca0df-10f4-4219-b39b-08b2c23912e1"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:31.276613 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2ff3ea44-2d37-4aad-98aa-fe0a879f880d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:31.283157 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2ff3ea44-2d37-4aad-98aa-fe0a879f880d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:31.283544 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2ff3ea44-2d37-4aad-98aa-fe0a879f880d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:31.284332 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2ff3ea44-2d37-4aad-98aa-fe0a879f880d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:31.284837 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2ff3ea44-2d37-4aad-98aa-fe0a879f880d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:31.300710 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=100 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:45:31.371729 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-2ff3ea44-2d37-4aad-98aa-fe0a879f880d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] HTTP exception thrown: Invalid volume: volume 50fca0df-10f4-4219-b39b-08b2c23912e1 is already attached to instances: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d Jul 01 16:45:31.373543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2ff3ea44-2d37-4aad-98aa-fe0a879f880d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Request method failure captured: Jul 01 16:45:31.373543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: POST /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d/os-volume_attachments HTTP/1.1 Jul 01 16:45:31.373543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:45:31.373543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:45:31.373543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:45:31.373543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 74 Jul 01 16:45:31.373543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:45:31.373543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:45:31.373543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:45:31.373543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:45:31.373543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyN28kRS6gk46UU5wMmPqqrbKCAlsLmUAL51tGA7XZ2wRJWF2nXTu75kTgDFZ7hA4wbbjyjFuM6MIxqsPPN7wq3gn9HT9lV3kgc_ncS5tAqdDIsXq38bqSWgq9ddXJaghqMv_F2GaWnIjXUUxQMmZS8lrawCYahe-iQxu0RYfE47KKI Jul 01 16:45:31.373543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:45:31.373543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:45:31.373543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:45:31.373543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:45:31.373543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:45:31.373543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:45:31.373543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:45:31.373543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:45:31.373543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:45:31.373543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:45:31.375173 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:45:31.375173 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:45:31.375173 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:45:31.375173 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:45:31.375173 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:45:31.375173 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:45:31.375173 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:45:31.375173 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: 7c4da21fbfa3472cac6e766a2f4799d8 Jul 01 16:45:31.375173 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:45:31.375173 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Jul 01 16:45:31.375173 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {"volumeAttachment": {"volumeId": "50fca0df-10f4-4219-b39b-08b2c23912e1"}} Jul 01 16:45:31.375173 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: > Jul 01 16:45:31.376091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Invalid volume: volume 50fca0df-10f4-4219-b39b-08b2c23912e1 is already attached to instances: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d Jul 01 16:45:31.376091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'server_id': '4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d', 'body': {'volumeAttachment': {'volumeId': '50fca0df-10f4-4219-b39b-08b2c23912e1'}}} Jul 01 16:45:31.376091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:45:31.376091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:45:31.376091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 01 16:45:31.376091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 01 16:45:31.376091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 16:45:31.376091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 16:45:31.376091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 01 16:45:31.376091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 16:45:31.376091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 01 16:45:31.376091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 01 16:45:31.376091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 01 16:45:31.376091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 01 16:45:31.376091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 50fca0df-10f4-4219-b39b-08b2c23912e1 is already attached to instances: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d Jul 01 16:45:31.376091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:45:31.376091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:45:31.376091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:45:31.376091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:45:31.377511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:45:31.377511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:45:31.377511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:45:31.377511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:45:31.377511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:45:31.377511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:45:31.377511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 16:45:31.377511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 16:45:31.377511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 16:45:31.377511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 16:45:31.377511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 16:45:31.377511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 16:45:31.377511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 01 16:45:31.377511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 01 16:45:31.377511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 50fca0df-10f4-4219-b39b-08b2c23912e1 is already attached to instances: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d Jul 01 16:45:31.377511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:45:31.377511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:45:31.377511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:45:31.377511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:45:31.377511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:45:31.378901 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:45:31.378901 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:45:31.378901 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:45:31.378901 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 50fca0df-10f4-4219-b39b-08b2c23912e1 is already attached to instances: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d Jul 01 16:45:31.378901 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:45:31.378901 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2ff3ea44-2d37-4aad-98aa-fe0a879f880d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Returning 400 to user: Invalid volume: volume 50fca0df-10f4-4219-b39b-08b2c23912e1 is already attached to instances: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:45:31.378901 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2ff3ea44-2d37-4aad-98aa-fe0a879f880d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "POST /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106737 Jul 01 16:45:31.378901 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 327/642] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 1 16:45:31 2022] POST /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 16:45:31.442724 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ce80666f-d8c7-4a76-be00-06c86f4e83e6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:31.443407 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ce80666f-d8c7-4a76-be00-06c86f4e83e6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:31.451055 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ce80666f-d8c7-4a76-be00-06c86f4e83e6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:31.451500 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ce80666f-d8c7-4a76-be00-06c86f4e83e6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:31.452502 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ce80666f-d8c7-4a76-be00-06c86f4e83e6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:31.453127 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ce80666f-d8c7-4a76-be00-06c86f4e83e6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:31.539981 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-ce80666f-d8c7-4a76-be00-06c86f4e83e6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lazy-loading 'services' on Instance uuid 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:45:31.621349 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ce80666f-d8c7-4a76-be00-06c86f4e83e6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d/os-volume_attachments/50fca0df-10f4-4219-b39b-08b2c23912e1" status: 202 len: 0 microversion: 2.1 time: 0.183347 Jul 01 16:45:31.621937 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 316/643] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 1 16:45:31 2022] DELETE /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d/os-volume_attachments/50fca0df-10f4-4219-b39b-08b2c23912e1 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:45:31.638158 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-db5d2a2d-11db-4ee6-a836-75dc4f71f9da tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:31.645016 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-db5d2a2d-11db-4ee6-a836-75dc4f71f9da tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:31.658208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-db5d2a2d-11db-4ee6-a836-75dc4f71f9da tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:31.661082 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-db5d2a2d-11db-4ee6-a836-75dc4f71f9da tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:31.662641 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-db5d2a2d-11db-4ee6-a836-75dc4f71f9da tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:31.663816 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-db5d2a2d-11db-4ee6-a836-75dc4f71f9da tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:31.697412 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-db5d2a2d-11db-4ee6-a836-75dc4f71f9da tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070342 Jul 01 16:45:31.698136 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 328/644] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 1 16:45:31 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:45:32.712471 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7a7fb047-1cb6-4103-aa34-0139170a19a8 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:32.713531 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7a7fb047-1cb6-4103-aa34-0139170a19a8 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:32.720547 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7a7fb047-1cb6-4103-aa34-0139170a19a8 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:32.721002 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7a7fb047-1cb6-4103-aa34-0139170a19a8 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:32.721779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7a7fb047-1cb6-4103-aa34-0139170a19a8 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:32.722213 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7a7fb047-1cb6-4103-aa34-0139170a19a8 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:32.753505 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7a7fb047-1cb6-4103-aa34-0139170a19a8 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046077 Jul 01 16:45:32.754077 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 317/645] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 1 16:45:32 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:45:33.769346 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9b8f6b62-993d-4e28-ae0c-c6b94d1904f0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:33.771062 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9b8f6b62-993d-4e28-ae0c-c6b94d1904f0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:33.781256 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9b8f6b62-993d-4e28-ae0c-c6b94d1904f0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:33.781876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9b8f6b62-993d-4e28-ae0c-c6b94d1904f0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:33.783124 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9b8f6b62-993d-4e28-ae0c-c6b94d1904f0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:33.783835 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9b8f6b62-993d-4e28-ae0c-c6b94d1904f0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:33.840263 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9b8f6b62-993d-4e28-ae0c-c6b94d1904f0 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078196 Jul 01 16:45:33.841238 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 329/646] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 1 16:45:33 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 16:45:33.904394 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e545db0b-eea1-4a00-9256-992543c4d538 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:33.904971 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e545db0b-eea1-4a00-9256-992543c4d538 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:33.911898 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e545db0b-eea1-4a00-9256-992543c4d538 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:33.912426 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e545db0b-eea1-4a00-9256-992543c4d538 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:33.913663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e545db0b-eea1-4a00-9256-992543c4d538 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:33.914146 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e545db0b-eea1-4a00-9256-992543c4d538 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:33.940294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e545db0b-eea1-4a00-9256-992543c4d538 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Going to try to terminate instance {{(pid=124317) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 16:45:34.023255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e545db0b-eea1-4a00-9256-992543c4d538 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 204 len: 0 microversion: 2.1 time: 0.122141 Jul 01 16:45:34.024561 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 318/647] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:45:33 2022] DELETE /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 16:45:34.034327 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f56dbd0f-0b06-46e1-841f-9b246931b989 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:34.035059 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f56dbd0f-0b06-46e1-841f-9b246931b989 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:34.041507 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f56dbd0f-0b06-46e1-841f-9b246931b989 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:34.042039 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f56dbd0f-0b06-46e1-841f-9b246931b989 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:34.042924 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f56dbd0f-0b06-46e1-841f-9b246931b989 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:34.043451 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f56dbd0f-0b06-46e1-841f-9b246931b989 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:34.191523 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f56dbd0f-0b06-46e1-841f-9b246931b989 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:34.200347 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f56dbd0f-0b06-46e1-841f-9b246931b989 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 200 len: 1681 microversion: 2.1 time: 0.170833 Jul 01 16:45:34.200927 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 330/648] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:34 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:35.218224 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-061fd969-20f5-4c02-bcee-98e51e5c9b30 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:35.218992 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-061fd969-20f5-4c02-bcee-98e51e5c9b30 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:35.221396 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:45:35.227793 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-061fd969-20f5-4c02-bcee-98e51e5c9b30 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:35.228242 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-061fd969-20f5-4c02-bcee-98e51e5c9b30 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:35.229005 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-061fd969-20f5-4c02-bcee-98e51e5c9b30 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:35.229445 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-061fd969-20f5-4c02-bcee-98e51e5c9b30 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:35.232876 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:45:35.367734 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-061fd969-20f5-4c02-bcee-98e51e5c9b30 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:35.375210 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-061fd969-20f5-4c02-bcee-98e51e5c9b30 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 200 len: 1681 microversion: 2.1 time: 0.161251 Jul 01 16:45:35.375773 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 319/649] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:35 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:35.856407 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ad67a7b5-f0bd-45b5-963e-dd7950612493 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:35.856913 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ad67a7b5-f0bd-45b5-963e-dd7950612493 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:35.863435 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ad67a7b5-f0bd-45b5-963e-dd7950612493 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:35.863887 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ad67a7b5-f0bd-45b5-963e-dd7950612493 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:35.864665 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ad67a7b5-f0bd-45b5-963e-dd7950612493 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:35.865101 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ad67a7b5-f0bd-45b5-963e-dd7950612493 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:35.942055 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-ad67a7b5-f0bd-45b5-963e-dd7950612493 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lazy-loading 'services' on Instance uuid f084bd09-4d9f-4dfc-8166-711a8c80cbee {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:45:36.012858 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ad67a7b5-f0bd-45b5-963e-dd7950612493 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee/os-volume_attachments/f09a1698-2666-417c-82e7-43313dfb3252" status: 202 len: 0 microversion: 2.1 time: 0.160185 Jul 01 16:45:36.013433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 331/650] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 1 16:45:35 2022] DELETE /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee/os-volume_attachments/f09a1698-2666-417c-82e7-43313dfb3252 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:45:36.021648 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-79d41617-e404-46ba-8b39-ab8818c0d660 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:36.023209 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-79d41617-e404-46ba-8b39-ab8818c0d660 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:36.029433 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-79d41617-e404-46ba-8b39-ab8818c0d660 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:36.029963 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-79d41617-e404-46ba-8b39-ab8818c0d660 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:36.030793 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-79d41617-e404-46ba-8b39-ab8818c0d660 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:36.031229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-79d41617-e404-46ba-8b39-ab8818c0d660 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:36.061299 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-79d41617-e404-46ba-8b39-ab8818c0d660 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043332 Jul 01 16:45:36.061802 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 320/651] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 1 16:45:36 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:45:36.393741 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e28e7d90-3402-40aa-ac8b-c025de9b971a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:36.394607 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e28e7d90-3402-40aa-ac8b-c025de9b971a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:36.401093 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e28e7d90-3402-40aa-ac8b-c025de9b971a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:36.401623 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e28e7d90-3402-40aa-ac8b-c025de9b971a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:36.402558 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e28e7d90-3402-40aa-ac8b-c025de9b971a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:36.403363 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e28e7d90-3402-40aa-ac8b-c025de9b971a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:36.631263 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e28e7d90-3402-40aa-ac8b-c025de9b971a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:36.639636 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e28e7d90-3402-40aa-ac8b-c025de9b971a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 200 len: 1681 microversion: 2.1 time: 0.250221 Jul 01 16:45:36.640328 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 332/652] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:36 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 1681 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:37.021035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-6eb48476-8d4e-41f2-b6ad-4647938b54fa req-92e04810-181b-4a90-b5c7-494e2070d097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d", "name": "network-vif-deleted", "tag": "3048ed1f-ed3c-4ece-8895-278d40e90955"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:37.030572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-6eb48476-8d4e-41f2-b6ad-4647938b54fa req-92e04810-181b-4a90-b5c7-494e2070d097 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:37.031243 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-6eb48476-8d4e-41f2-b6ad-4647938b54fa req-92e04810-181b-4a90-b5c7-494e2070d097 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:37.048593 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-6eb48476-8d4e-41f2-b6ad-4647938b54fa req-92e04810-181b-4a90-b5c7-494e2070d097 service nova] Creating event network-vif-deleted:3048ed1f-ed3c-4ece-8895-278d40e90955 for instance 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d on hv-cinder-79760 Jul 01 16:45:37.059507 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-6eb48476-8d4e-41f2-b6ad-4647938b54fa req-92e04810-181b-4a90-b5c7-494e2070d097 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042331 Jul 01 16:45:37.061756 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 321/653] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:45:37.076116 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-55d20ab4-ce0d-405e-aca7-ea9ac27e1126 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:37.077053 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-55d20ab4-ce0d-405e-aca7-ea9ac27e1126 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:37.083368 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-55d20ab4-ce0d-405e-aca7-ea9ac27e1126 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:37.084079 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-55d20ab4-ce0d-405e-aca7-ea9ac27e1126 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:37.085035 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-55d20ab4-ce0d-405e-aca7-ea9ac27e1126 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:37.085577 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-55d20ab4-ce0d-405e-aca7-ea9ac27e1126 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:37.120607 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-55d20ab4-ce0d-405e-aca7-ea9ac27e1126 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048460 Jul 01 16:45:37.121570 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 333/654] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 1 16:45:37 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:45:37.658583 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5fd1465f-e5f8-4d58-8e9b-852f9575899a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:37.659425 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5fd1465f-e5f8-4d58-8e9b-852f9575899a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:37.667121 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5fd1465f-e5f8-4d58-8e9b-852f9575899a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:37.667701 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5fd1465f-e5f8-4d58-8e9b-852f9575899a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:37.668662 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5fd1465f-e5f8-4d58-8e9b-852f9575899a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:37.669122 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5fd1465f-e5f8-4d58-8e9b-852f9575899a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:37.683201 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-5fd1465f-e5f8-4d58-8e9b-852f9575899a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] HTTP exception thrown: Instance 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d could not be found. Jul 01 16:45:37.684880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5fd1465f-e5f8-4d58-8e9b-852f9575899a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Request method failure captured: Jul 01 16:45:37.684880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d HTTP/1.1 Jul 01 16:45:37.684880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:45:37.684880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:45:37.684880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:45:37.684880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:45:37.684880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:45:37.684880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:45:37.684880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:45:37.684880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:45:37.684880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyN28kRS6gk46UU5wMmPqqrbKCAlsLmUAL51tGA7XZ2wRJWF2nXTu75kTgDFZ7hA4wbbjyjFuM6MIxqsPPN7wq3gn9HT9lV3kgc_ncS5tAqdDIsXq38bqSWgq9ddXJaghqMv_F2GaWnIjXUUxQMmZS8lrawCYahe-iQxu0RYfE47KKI Jul 01 16:45:37.684880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:45:37.684880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:45:37.684880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:45:37.684880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:45:37.684880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:45:37.684880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:45:37.684880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:45:37.684880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:45:37.684880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:45:37.684880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:45:37.686391 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:45:37.686391 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:45:37.686391 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:45:37.686391 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:45:37.686391 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:45:37.686391 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:45:37.686391 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:45:37.686391 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: 7c4da21fbfa3472cac6e766a2f4799d8 Jul 01 16:45:37.686391 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:45:37.686391 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:45:37.686391 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d could not be found. Jul 01 16:45:37.686391 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': '4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d'} Jul 01 16:45:37.687285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:45:37.687285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:45:37.687285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:45:37.687285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:45:37.687285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:45:37.687285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:45:37.687285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:45:37.687285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:45:37.687285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:45:37.687285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:45:37.687285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d could not be found. Jul 01 16:45:37.687285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:37.687285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:45:37.687285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:37.687285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:45:37.687285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:45:37.687285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:45:37.687285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:45:37.687285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:45:37.687285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:45:37.688737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:45:37.688737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:45:37.688737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:45:37.688737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:45:37.688737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:45:37.688737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:45:37.688737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:45:37.688737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d could not be found. Jul 01 16:45:37.688737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:37.688737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:45:37.688737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:37.688737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:45:37.688737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:45:37.688737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:45:37.688737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:45:37.688737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:45:37.688737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d could not be found. Jul 01 16:45:37.688737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:37.690014 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5fd1465f-e5f8-4d58-8e9b-852f9575899a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Returning 404 to user: Instance 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:45:37.690014 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5fd1465f-e5f8-4d58-8e9b-852f9575899a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 404 len: 111 microversion: 2.1 time: 0.032136 Jul 01 16:45:37.690014 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 322/655] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:37 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:45:37.699996 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-bb19bb0d-9fdf-479c-8c66-d1b96050165a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '.version_select at 0x7fa85f3beaf0>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:37.721132 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-bb19bb0d-9fdf-479c-8c66-d1b96050165a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2048210868" status: 202 len: 0 microversion: 2.1 time: 0.025087 Jul 01 16:45:37.722070 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 334/656] 10.222.0.57 () {58 vars in 1220 bytes} [Fri Jul 1 16:45:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2048210868 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 16:45:38.134399 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-dac43b5c-e04c-4d8a-90b8-985653c5feae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:38.137069 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-dac43b5c-e04c-4d8a-90b8-985653c5feae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:38.146995 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dac43b5c-e04c-4d8a-90b8-985653c5feae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:38.149690 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dac43b5c-e04c-4d8a-90b8-985653c5feae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:38.150259 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dac43b5c-e04c-4d8a-90b8-985653c5feae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:38.150801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dac43b5c-e04c-4d8a-90b8-985653c5feae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:38.181549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-dac43b5c-e04c-4d8a-90b8-985653c5feae tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052531 Jul 01 16:45:38.182609 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 323/657] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 1 16:45:38 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 01 16:45:38.253165 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3728cebf-bc3a-43a7-b3f5-a73b0f79615a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:38.254485 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3728cebf-bc3a-43a7-b3f5-a73b0f79615a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:38.261576 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3728cebf-bc3a-43a7-b3f5-a73b0f79615a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:38.262023 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3728cebf-bc3a-43a7-b3f5-a73b0f79615a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:38.262823 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3728cebf-bc3a-43a7-b3f5-a73b0f79615a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:38.263259 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3728cebf-bc3a-43a7-b3f5-a73b0f79615a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:38.289656 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3728cebf-bc3a-43a7-b3f5-a73b0f79615a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 16:45:38.375225 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3728cebf-bc3a-43a7-b3f5-a73b0f79615a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 204 len: 0 microversion: 2.1 time: 0.125505 Jul 01 16:45:38.376022 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 335/658] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:45:38 2022] DELETE /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 16:45:38.385996 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9ca87bc9-65bc-45ae-92fd-408a1260640c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:38.386262 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5c5055a2-93c2-4e86-adf8-bfa4fb75f799 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Action: 'create', calling method: .version_select at 0x7fa86c55b0d0>, body: {"keypair": {"name": "tempest-keypair-1219704145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCl8lGPYI3IadAlDtoELmWXojdQg+v/3qCtCn68VgQzTSa1OlCCvXkD7sOsi1mk6c+jSzVLgkSm85aUKH/lRvIA9CLTYx9qe50qSDnQs59hLkS4LvcaMqJF27xA0mWx2NQ=="}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:38.386790 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9ca87bc9-65bc-45ae-92fd-408a1260640c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:38.392736 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ca87bc9-65bc-45ae-92fd-408a1260640c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:38.393180 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ca87bc9-65bc-45ae-92fd-408a1260640c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:38.393944 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ca87bc9-65bc-45ae-92fd-408a1260640c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:38.394408 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ca87bc9-65bc-45ae-92fd-408a1260640c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:38.401653 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-5c5055a2-93c2-4e86-adf8-bfa4fb75f799 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Getting quotas for project 5747a83d930f4075a78e9b14abd58c7f. Resources: {'key_pairs'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:45:38.405598 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-5c5055a2-93c2-4e86-adf8-bfa4fb75f799 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Getting quotas for user 7c4da21fbfa3472cac6e766a2f4799d8 and project 5747a83d930f4075a78e9b14abd58c7f. Resources: {'key_pairs'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:45:38.435115 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5c5055a2-93c2-4e86-adf8-bfa4fb75f799 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053929 Jul 01 16:45:38.438527 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 324/659] 10.222.0.57 () {60 vars in 1158 bytes} [Fri Jul 1 16:45:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:45:38.539215 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9ca87bc9-65bc-45ae-92fd-408a1260640c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:38.550155 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9ca87bc9-65bc-45ae-92fd-408a1260640c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1688 microversion: 2.1 time: 0.168853 Jul 01 16:45:38.550904 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 336/660] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:38 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:39.568121 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2e6e3cda-5fa6-4a49-8496-88f9be097832 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:39.568991 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2e6e3cda-5fa6-4a49-8496-88f9be097832 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:39.577268 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2e6e3cda-5fa6-4a49-8496-88f9be097832 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:39.577627 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2e6e3cda-5fa6-4a49-8496-88f9be097832 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:39.578618 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2e6e3cda-5fa6-4a49-8496-88f9be097832 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:39.579324 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2e6e3cda-5fa6-4a49-8496-88f9be097832 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:39.752656 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2e6e3cda-5fa6-4a49-8496-88f9be097832 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:39.761214 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2e6e3cda-5fa6-4a49-8496-88f9be097832 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1688 microversion: 2.1 time: 0.197449 Jul 01 16:45:39.761778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 325/661] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:39 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1688 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:39.807590 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4d2bc198-150e-4c36-8bb0-e32feff351d6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1402009121", "imageRef": "42a4b1a9-dea6-4c87-a2c1-328b9c0c8558", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c5acd85f-f778-4915-8079-a3e9582e6528"}], "security_groups": [{"name": "tempest-securitygroup--263819969"}], "key_name": "tempest-keypair-1219704145", "user_data": "}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:39.815015 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:45:39.923819 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-4d2bc198-150e-4c36-8bb0-e32feff351d6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] validate_networks() for [('c5acd85f-f778-4915-8079-a3e9582e6528', None, None, None, None, None)] {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 16:45:40.367913 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-4d2bc198-150e-4c36-8bb0-e32feff351d6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 16:45:40.368343 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-4d2bc198-150e-4c36-8bb0-e32feff351d6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 16:45:40.368825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-4d2bc198-150e-4c36-8bb0-e32feff351d6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 16:45:40.369240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-4d2bc198-150e-4c36-8bb0-e32feff351d6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 16:45:40.369833 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-4d2bc198-150e-4c36-8bb0-e32feff351d6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 16:45:40.381694 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4d2bc198-150e-4c36-8bb0-e32feff351d6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:40.382549 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4d2bc198-150e-4c36-8bb0-e32feff351d6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:40.383416 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4d2bc198-150e-4c36-8bb0-e32feff351d6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:40.383857 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4d2bc198-150e-4c36-8bb0-e32feff351d6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:40.408313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-4d2bc198-150e-4c36-8bb0-e32feff351d6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Getting quotas for project 5747a83d930f4075a78e9b14abd58c7f. Resources: {'ram', 'cores', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:45:40.412443 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-4d2bc198-150e-4c36-8bb0-e32feff351d6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Getting quotas for user 7c4da21fbfa3472cac6e766a2f4799d8 and project 5747a83d930f4075a78e9b14abd58c7f. Resources: {'ram', 'cores', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:45:40.425430 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4d2bc198-150e-4c36-8bb0-e32feff351d6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 16:45:40.428220 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4d2bc198-150e-4c36-8bb0-e32feff351d6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42a4b1a9-dea6-4c87-a2c1-328b9c0c8558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 16:45:40.480656 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4d2bc198-150e-4c36-8bb0-e32feff351d6 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.678572 Jul 01 16:45:40.481831 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 337/662] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 1 16:45:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 16:45:40.495996 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-edc91fef-93c0-4344-9f73-c780e50b8fd4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:40.496698 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-edc91fef-93c0-4344-9f73-c780e50b8fd4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:40.781014 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-05231d75-ede6-4440-8976-512f69b09b18 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:40.781635 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-05231d75-ede6-4440-8976-512f69b09b18 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:40.792239 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-05231d75-ede6-4440-8976-512f69b09b18 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:40.792697 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-05231d75-ede6-4440-8976-512f69b09b18 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:40.793541 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-05231d75-ede6-4440-8976-512f69b09b18 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:40.793950 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-05231d75-ede6-4440-8976-512f69b09b18 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:40.817908 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-edc91fef-93c0-4344-9f73-c780e50b8fd4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:40.825513 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-edc91fef-93c0-4344-9f73-c780e50b8fd4 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b" status: 200 len: 1242 microversion: 2.1 time: 0.334239 Jul 01 16:45:40.826303 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 326/663] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:40 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b => generated 1242 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:45:40.949163 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-05231d75-ede6-4440-8976-512f69b09b18 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:40.957093 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-05231d75-ede6-4440-8976-512f69b09b18 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1688 microversion: 2.1 time: 0.181678 Jul 01 16:45:40.957762 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 338/664] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:40 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:45:41.844366 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b5f35163-d14a-477c-a225-1d2891cdf541 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:41.844889 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b5f35163-d14a-477c-a225-1d2891cdf541 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:41.853608 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b5f35163-d14a-477c-a225-1d2891cdf541 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:41.854052 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b5f35163-d14a-477c-a225-1d2891cdf541 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:41.854846 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b5f35163-d14a-477c-a225-1d2891cdf541 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:41.855507 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b5f35163-d14a-477c-a225-1d2891cdf541 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:41.916164 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b5f35163-d14a-477c-a225-1d2891cdf541 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:41.923626 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b5f35163-d14a-477c-a225-1d2891cdf541 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b" status: 200 len: 1246 microversion: 2.1 time: 0.083169 Jul 01 16:45:41.924201 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 327/665] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:41 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:45:41.976163 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f8481b49-2635-41e4-a6d4-985064c63901 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:41.976781 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f8481b49-2635-41e4-a6d4-985064c63901 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:41.983241 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f8481b49-2635-41e4-a6d4-985064c63901 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:41.983688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f8481b49-2635-41e4-a6d4-985064c63901 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:41.984446 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f8481b49-2635-41e4-a6d4-985064c63901 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:41.984880 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f8481b49-2635-41e4-a6d4-985064c63901 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:42.123031 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f8481b49-2635-41e4-a6d4-985064c63901 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:42.130701 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f8481b49-2635-41e4-a6d4-985064c63901 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1688 microversion: 2.1 time: 0.158820 Jul 01 16:45:42.131262 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 339/666] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:41 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:42.941247 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f728c492-f27d-4784-b97e-a05dd5304040 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:42.942447 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f728c492-f27d-4784-b97e-a05dd5304040 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:42.949892 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f728c492-f27d-4784-b97e-a05dd5304040 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:42.950386 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f728c492-f27d-4784-b97e-a05dd5304040 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:42.951157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f728c492-f27d-4784-b97e-a05dd5304040 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:42.951595 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f728c492-f27d-4784-b97e-a05dd5304040 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:43.056077 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f728c492-f27d-4784-b97e-a05dd5304040 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:43.063565 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f728c492-f27d-4784-b97e-a05dd5304040 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b" status: 200 len: 1312 microversion: 2.1 time: 0.126467 Jul 01 16:45:43.064131 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 328/667] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:42 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b => generated 1312 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:43.148713 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1abf6da7-67ca-498e-9436-a6e12acaf967 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:43.149318 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1abf6da7-67ca-498e-9436-a6e12acaf967 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:43.156137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1abf6da7-67ca-498e-9436-a6e12acaf967 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:43.156697 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1abf6da7-67ca-498e-9436-a6e12acaf967 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:43.157706 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1abf6da7-67ca-498e-9436-a6e12acaf967 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:43.158147 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1abf6da7-67ca-498e-9436-a6e12acaf967 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:43.378619 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-1abf6da7-67ca-498e-9436-a6e12acaf967 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:43.390870 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1abf6da7-67ca-498e-9436-a6e12acaf967 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 200 len: 1688 microversion: 2.1 time: 0.246523 Jul 01 16:45:43.391455 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 340/668] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:43 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 1688 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:43.661121 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-daa5490c-6a9b-4d8b-a220-0d4bb4a49757 req-a6eaa216-9a75-4b69-b789-5f0e4008e3f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f084bd09-4d9f-4dfc-8166-711a8c80cbee", "name": "network-vif-deleted", "tag": "b1c38327-6c47-4d4f-bcc3-847a86785a63"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:43.674897 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-daa5490c-6a9b-4d8b-a220-0d4bb4a49757 req-a6eaa216-9a75-4b69-b789-5f0e4008e3f3 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:43.675341 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-daa5490c-6a9b-4d8b-a220-0d4bb4a49757 req-a6eaa216-9a75-4b69-b789-5f0e4008e3f3 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:43.711992 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-daa5490c-6a9b-4d8b-a220-0d4bb4a49757 req-a6eaa216-9a75-4b69-b789-5f0e4008e3f3 service nova] Creating event network-vif-deleted:b1c38327-6c47-4d4f-bcc3-847a86785a63 for instance f084bd09-4d9f-4dfc-8166-711a8c80cbee on hv-cinder-79760 Jul 01 16:45:43.719897 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-daa5490c-6a9b-4d8b-a220-0d4bb4a49757 req-a6eaa216-9a75-4b69-b789-5f0e4008e3f3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062421 Jul 01 16:45:43.720899 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 329/669] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:45:44.080891 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-25be4533-ffb8-462f-8fad-e5f6eaf2506e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:44.081539 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-25be4533-ffb8-462f-8fad-e5f6eaf2506e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:44.088083 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-25be4533-ffb8-462f-8fad-e5f6eaf2506e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:44.088744 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-25be4533-ffb8-462f-8fad-e5f6eaf2506e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:44.089516 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-25be4533-ffb8-462f-8fad-e5f6eaf2506e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:44.090106 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-25be4533-ffb8-462f-8fad-e5f6eaf2506e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:44.247364 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-25be4533-ffb8-462f-8fad-e5f6eaf2506e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:44.260196 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-25be4533-ffb8-462f-8fad-e5f6eaf2506e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b" status: 200 len: 1367 microversion: 2.1 time: 0.181183 Jul 01 16:45:44.261567 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 341/670] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:44 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:44.412099 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-15e946a9-bc07-4777-9041-35b491f8adfe tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:44.412524 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-15e946a9-bc07-4777-9041-35b491f8adfe tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: f084bd09-4d9f-4dfc-8166-711a8c80cbee] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:44.426207 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-15e946a9-bc07-4777-9041-35b491f8adfe tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:44.426956 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-15e946a9-bc07-4777-9041-35b491f8adfe tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:44.428053 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-15e946a9-bc07-4777-9041-35b491f8adfe tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:44.430476 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-15e946a9-bc07-4777-9041-35b491f8adfe tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:44.452532 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-15e946a9-bc07-4777-9041-35b491f8adfe tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] HTTP exception thrown: Instance f084bd09-4d9f-4dfc-8166-711a8c80cbee could not be found. Jul 01 16:45:44.454420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-15e946a9-bc07-4777-9041-35b491f8adfe tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Request method failure captured: Jul 01 16:45:44.454420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee HTTP/1.1 Jul 01 16:45:44.454420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:45:44.454420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:45:44.454420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:45:44.454420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:45:44.454420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:45:44.454420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:45:44.454420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:45:44.454420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:45:44.454420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyOI-s3iPDB4YLflXSSRZWcau0vhHiVagbazYRJFMf9-OokthaqI0R_YfsAgJ8HN57hiV6pLMlhwp8sGg5hnPn2V7hGYaEstnvtMh8Gwcl3eCgjot-5oXe0pZAz2Wj1DG2Utw8Q4W96USbDVD_e5F1KghjdjHfBU_BAZG2dmgSw5D10 Jul 01 16:45:44.454420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:45:44.454420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:45:44.454420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:45:44.454420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:45:44.454420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:45:44.454420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:45:44.454420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: bf55d220c94d4445af9f73c532029e42 Jul 01 16:45:44.454420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1802263634 Jul 01 16:45:44.454420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:45:44.454420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:45:44.456022 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bf55d220c94d4445af9f73c532029e42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bf55d220c94d4445af9f73c532029e42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bf55d220c94d4445af9f73c532029e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bf55d220c94d4445af9f73c532029e42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:45:44.456022 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1802263634 Jul 01 16:45:44.456022 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: bf55d220c94d4445af9f73c532029e42 Jul 01 16:45:44.456022 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1802263634 Jul 01 16:45:44.456022 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-ServerRescueNegativeTestJSON-1802263634-project Jul 01 16:45:44.456022 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:45:44.456022 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:45:44.456022 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: 71c383c04f9543d8ab97a6c0db268ca5 Jul 01 16:45:44.456022 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1802263634-project Jul 01 16:45:44.456022 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:45:44.456022 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance f084bd09-4d9f-4dfc-8166-711a8c80cbee could not be found. Jul 01 16:45:44.456022 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': 'f084bd09-4d9f-4dfc-8166-711a8c80cbee'} Jul 01 16:45:44.456924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:45:44.456924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:45:44.456924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:45:44.456924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:45:44.456924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:45:44.456924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:45:44.456924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:45:44.456924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:45:44.456924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:45:44.456924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:45:44.456924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f084bd09-4d9f-4dfc-8166-711a8c80cbee could not be found. Jul 01 16:45:44.456924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:44.456924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:45:44.456924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:44.456924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:45:44.456924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:45:44.456924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:45:44.456924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:45:44.456924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:45:44.456924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:45:44.458395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:45:44.458395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:45:44.458395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:45:44.458395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:45:44.458395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:45:44.458395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:45:44.458395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:45:44.458395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f084bd09-4d9f-4dfc-8166-711a8c80cbee could not be found. Jul 01 16:45:44.458395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:44.458395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:45:44.458395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:44.458395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:45:44.458395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:45:44.458395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:45:44.458395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:45:44.458395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:45:44.458395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f084bd09-4d9f-4dfc-8166-711a8c80cbee could not be found. Jul 01 16:45:44.458395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:44.461632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-15e946a9-bc07-4777-9041-35b491f8adfe tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Returning 404 to user: Instance f084bd09-4d9f-4dfc-8166-711a8c80cbee could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:45:44.462691 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-15e946a9-bc07-4777-9041-35b491f8adfe tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee" status: 404 len: 111 microversion: 2.1 time: 0.057208 Jul 01 16:45:44.463862 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 330/671] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:44 2022] GET /compute/v2.1/servers/f084bd09-4d9f-4dfc-8166-711a8c80cbee => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:45:44.471897 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-34a3a06a-8ff4-4e29-8db3-61e821ceeca0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '.version_select at 0x7fa85f2e0040>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:44.499543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-34a3a06a-8ff4-4e29-8db3-61e821ceeca0 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1060489518" status: 202 len: 0 microversion: 2.1 time: 0.031438 Jul 01 16:45:44.501224 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 342/672] 10.222.0.57 () {58 vars in 1220 bytes} [Fri Jul 1 16:45:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1060489518 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:45:44.557195 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-6b40f417-d18e-40a1-84b2-05d2dd70c0e0 req-c9fef915-2b83-44a6-b8d4-b642608a516b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "065f34be-ae7e-43dc-8ff4-9656de8e4f9b", "tag": "e1d9786d-77cd-467e-a907-5d453b790339"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:44.573835 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-6b40f417-d18e-40a1-84b2-05d2dd70c0e0 req-c9fef915-2b83-44a6-b8d4-b642608a516b service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:44.574510 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-6b40f417-d18e-40a1-84b2-05d2dd70c0e0 req-c9fef915-2b83-44a6-b8d4-b642608a516b service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:44.611484 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-6b40f417-d18e-40a1-84b2-05d2dd70c0e0 req-c9fef915-2b83-44a6-b8d4-b642608a516b service nova] Creating event network-changed:e1d9786d-77cd-467e-a907-5d453b790339 for instance 065f34be-ae7e-43dc-8ff4-9656de8e4f9b on hv-cinder-79760 Jul 01 16:45:44.625565 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-6b40f417-d18e-40a1-84b2-05d2dd70c0e0 req-c9fef915-2b83-44a6-b8d4-b642608a516b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073221 Jul 01 16:45:44.626539 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 331/673] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:45:45.277761 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-200a2e44-6faf-4b20-b6c9-3af1cf9e86f1 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:45.278403 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-200a2e44-6faf-4b20-b6c9-3af1cf9e86f1 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:45.284330 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-200a2e44-6faf-4b20-b6c9-3af1cf9e86f1 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:45.284771 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-200a2e44-6faf-4b20-b6c9-3af1cf9e86f1 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:45.285526 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-200a2e44-6faf-4b20-b6c9-3af1cf9e86f1 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:45.285962 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-200a2e44-6faf-4b20-b6c9-3af1cf9e86f1 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:45.423660 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-200a2e44-6faf-4b20-b6c9-3af1cf9e86f1 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:45.432010 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-200a2e44-6faf-4b20-b6c9-3af1cf9e86f1 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b" status: 200 len: 1367 microversion: 2.1 time: 0.158595 Jul 01 16:45:45.432616 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 343/674] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:45 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:46.450624 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-77dc3cf3-06ac-44ef-a950-b8983b75ef2e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:46.451466 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-77dc3cf3-06ac-44ef-a950-b8983b75ef2e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:46.458024 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-77dc3cf3-06ac-44ef-a950-b8983b75ef2e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:46.458865 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-77dc3cf3-06ac-44ef-a950-b8983b75ef2e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:46.460865 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-77dc3cf3-06ac-44ef-a950-b8983b75ef2e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:46.461069 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-77dc3cf3-06ac-44ef-a950-b8983b75ef2e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:46.608298 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-77dc3cf3-06ac-44ef-a950-b8983b75ef2e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:46.616612 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-77dc3cf3-06ac-44ef-a950-b8983b75ef2e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b" status: 200 len: 1367 microversion: 2.1 time: 0.170181 Jul 01 16:45:46.617164 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 332/675] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:46 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:47.582708 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-432dc367-be16-4a43-a1c1-94681a7d6457 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:47.584039 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-432dc367-be16-4a43-a1c1-94681a7d6457 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:47.591278 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-432dc367-be16-4a43-a1c1-94681a7d6457 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:47.591731 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-432dc367-be16-4a43-a1c1-94681a7d6457 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:47.592508 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-432dc367-be16-4a43-a1c1-94681a7d6457 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:47.592947 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-432dc367-be16-4a43-a1c1-94681a7d6457 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:47.608191 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:45:47.622628 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-432dc367-be16-4a43-a1c1-94681a7d6457 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 16:45:47.633984 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-15edc139-b28c-4b8c-8d91-c83637209b50 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:47.634616 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-15edc139-b28c-4b8c-8d91-c83637209b50 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:47.641012 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-15edc139-b28c-4b8c-8d91-c83637209b50 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:47.641685 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-15edc139-b28c-4b8c-8d91-c83637209b50 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:47.642686 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-15edc139-b28c-4b8c-8d91-c83637209b50 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:47.643115 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-15edc139-b28c-4b8c-8d91-c83637209b50 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:47.728627 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-432dc367-be16-4a43-a1c1-94681a7d6457 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 204 len: 0 microversion: 2.1 time: 0.149129 Jul 01 16:45:47.729300 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 344/676] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:45:47 2022] DELETE /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 16:45:47.737947 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-350a99e7-8a50-4631-b1d9-86149a92c91f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:47.738696 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-350a99e7-8a50-4631-b1d9-86149a92c91f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:47.745460 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-350a99e7-8a50-4631-b1d9-86149a92c91f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:47.745919 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-350a99e7-8a50-4631-b1d9-86149a92c91f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:47.746836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-350a99e7-8a50-4631-b1d9-86149a92c91f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:47.747909 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-350a99e7-8a50-4631-b1d9-86149a92c91f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:47.791135 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-15edc139-b28c-4b8c-8d91-c83637209b50 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:47.799825 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-15edc139-b28c-4b8c-8d91-c83637209b50 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b" status: 200 len: 1367 microversion: 2.1 time: 0.170477 Jul 01 16:45:47.800975 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 333/677] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:47 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:45:47.903670 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-350a99e7-8a50-4631-b1d9-86149a92c91f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:47.911236 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-350a99e7-8a50-4631-b1d9-86149a92c91f tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1507 microversion: 2.1 time: 0.177601 Jul 01 16:45:47.911804 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 345/678] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:47 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:48.817077 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-bec67f12-b7ea-4c7b-95e5-8e7aaa56bb76 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:48.817685 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-bec67f12-b7ea-4c7b-95e5-8e7aaa56bb76 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:48.824563 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bec67f12-b7ea-4c7b-95e5-8e7aaa56bb76 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:48.825053 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bec67f12-b7ea-4c7b-95e5-8e7aaa56bb76 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:48.825829 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bec67f12-b7ea-4c7b-95e5-8e7aaa56bb76 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:48.826263 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bec67f12-b7ea-4c7b-95e5-8e7aaa56bb76 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:48.928594 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-05acca79-6239-4ddf-bc92-accb1ef63773 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:48.929360 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-05acca79-6239-4ddf-bc92-accb1ef63773 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:48.935850 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-05acca79-6239-4ddf-bc92-accb1ef63773 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:48.936309 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-05acca79-6239-4ddf-bc92-accb1ef63773 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:48.937084 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-05acca79-6239-4ddf-bc92-accb1ef63773 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:48.937521 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-05acca79-6239-4ddf-bc92-accb1ef63773 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:48.957004 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bec67f12-b7ea-4c7b-95e5-8e7aaa56bb76 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:48.965440 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-bec67f12-b7ea-4c7b-95e5-8e7aaa56bb76 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b" status: 200 len: 1367 microversion: 2.1 time: 0.152299 Jul 01 16:45:48.966015 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 334/679] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:48 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:49.070671 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-05acca79-6239-4ddf-bc92-accb1ef63773 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:49.078057 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-05acca79-6239-4ddf-bc92-accb1ef63773 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1507 microversion: 2.1 time: 0.153509 Jul 01 16:45:49.078643 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 346/680] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:48 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:49.708252 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-e9a4e344-b69d-48b6-a659-e16a4d611865 req-bb307568-6f7c-4c0c-8f92-b8adee995aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "065f34be-ae7e-43dc-8ff4-9656de8e4f9b", "name": "network-vif-plugged", "status": "completed", "tag": "e1d9786d-77cd-467e-a907-5d453b790339"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:49.717985 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-e9a4e344-b69d-48b6-a659-e16a4d611865 req-bb307568-6f7c-4c0c-8f92-b8adee995aea service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:49.718465 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-e9a4e344-b69d-48b6-a659-e16a4d611865 req-bb307568-6f7c-4c0c-8f92-b8adee995aea service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:49.730013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-e9a4e344-b69d-48b6-a659-e16a4d611865 req-bb307568-6f7c-4c0c-8f92-b8adee995aea service nova] Creating event network-vif-plugged:e1d9786d-77cd-467e-a907-5d453b790339 for instance 065f34be-ae7e-43dc-8ff4-9656de8e4f9b on hv-cinder-79760 Jul 01 16:45:49.734911 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-e9a4e344-b69d-48b6-a659-e16a4d611865 req-bb307568-6f7c-4c0c-8f92-b8adee995aea service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030840 Jul 01 16:45:49.735495 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 335/681] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:45:49.982534 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-74233bd0-2c40-416a-ac6b-33848d5776b9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:49.983151 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-74233bd0-2c40-416a-ac6b-33848d5776b9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:49.991654 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-74233bd0-2c40-416a-ac6b-33848d5776b9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:49.992103 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-74233bd0-2c40-416a-ac6b-33848d5776b9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:49.994232 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-74233bd0-2c40-416a-ac6b-33848d5776b9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:49.994706 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-74233bd0-2c40-416a-ac6b-33848d5776b9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:50.095983 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5eab37e6-53cd-49d1-ae5f-1ae34e571ff8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:50.096642 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5eab37e6-53cd-49d1-ae5f-1ae34e571ff8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:50.104744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5eab37e6-53cd-49d1-ae5f-1ae34e571ff8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:50.105093 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5eab37e6-53cd-49d1-ae5f-1ae34e571ff8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:50.105833 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5eab37e6-53cd-49d1-ae5f-1ae34e571ff8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:50.106269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5eab37e6-53cd-49d1-ae5f-1ae34e571ff8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:50.137542 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-74233bd0-2c40-416a-ac6b-33848d5776b9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:50.146274 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-74233bd0-2c40-416a-ac6b-33848d5776b9 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b" status: 200 len: 1367 microversion: 2.1 time: 0.167785 Jul 01 16:45:50.147455 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 347/682] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:49 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:50.240491 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5eab37e6-53cd-49d1-ae5f-1ae34e571ff8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:50.248459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5eab37e6-53cd-49d1-ae5f-1ae34e571ff8 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1507 microversion: 2.1 time: 0.156622 Jul 01 16:45:50.249031 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 336/683] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:50 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:45:51.155564 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:45:51.156416 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=6 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:45:51.164451 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9ee5fd10-b0dc-4aa8-8443-39b6447fa067 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:51.166023 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-9ee5fd10-b0dc-4aa8-8443-39b6447fa067 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:51.169060 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=6 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:45:51.175158 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9ee5fd10-b0dc-4aa8-8443-39b6447fa067 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:51.175624 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9ee5fd10-b0dc-4aa8-8443-39b6447fa067 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:51.176581 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9ee5fd10-b0dc-4aa8-8443-39b6447fa067 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:51.184284 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9ee5fd10-b0dc-4aa8-8443-39b6447fa067 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:51.322726 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-fd82c6e5-5813-49b5-8c69-af7ec34660d0 req-d8ff27d4-32a6-42e8-928a-c63f66232538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5", "name": "network-vif-deleted", "tag": "bdfbafea-3e39-44d2-9b40-9668e19b3334"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:51.331038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-fd82c6e5-5813-49b5-8c69-af7ec34660d0 req-d8ff27d4-32a6-42e8-928a-c63f66232538 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:51.331489 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-fd82c6e5-5813-49b5-8c69-af7ec34660d0 req-d8ff27d4-32a6-42e8-928a-c63f66232538 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:51.335793 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9ee5fd10-b0dc-4aa8-8443-39b6447fa067 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:51.344114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9ee5fd10-b0dc-4aa8-8443-39b6447fa067 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b" status: 200 len: 1367 microversion: 2.1 time: 0.184164 Jul 01 16:45:51.344695 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 337/684] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:51 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:51.345133 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-fd82c6e5-5813-49b5-8c69-af7ec34660d0 req-d8ff27d4-32a6-42e8-928a-c63f66232538 service nova] Creating event network-vif-deleted:bdfbafea-3e39-44d2-9b40-9668e19b3334 for instance a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 on hv-cinder-79760 Jul 01 16:45:51.349627 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2b7b07a4-862e-41f1-821f-449966cad699 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:51.350885 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2b7b07a4-862e-41f1-821f-449966cad699 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:51.356879 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-fd82c6e5-5813-49b5-8c69-af7ec34660d0 req-d8ff27d4-32a6-42e8-928a-c63f66232538 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205721 Jul 01 16:45:51.357323 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2b7b07a4-862e-41f1-821f-449966cad699 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:51.357790 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 348/685] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:45:51.357947 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2b7b07a4-862e-41f1-821f-449966cad699 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:51.358668 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2b7b07a4-862e-41f1-821f-449966cad699 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:51.359110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2b7b07a4-862e-41f1-821f-449966cad699 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:51.391868 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2b7b07a4-862e-41f1-821f-449966cad699 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:51.392237 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2b7b07a4-862e-41f1-821f-449966cad699 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:51.392685 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-2b7b07a4-862e-41f1-821f-449966cad699 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lazy-loading 'fault' on Instance uuid a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:45:51.441624 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2b7b07a4-862e-41f1-821f-449966cad699 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:51.449580 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2b7b07a4-862e-41f1-821f-449966cad699 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1311 microversion: 2.1 time: 0.103448 Jul 01 16:45:51.450168 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 338/686] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:51 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:52.362885 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-952dd40e-0933-4f92-afca-add77225dbdd tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:52.363592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-952dd40e-0933-4f92-afca-add77225dbdd tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:52.370658 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-952dd40e-0933-4f92-afca-add77225dbdd tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:52.371113 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-952dd40e-0933-4f92-afca-add77225dbdd tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:52.371883 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-952dd40e-0933-4f92-afca-add77225dbdd tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:52.372323 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-952dd40e-0933-4f92-afca-add77225dbdd tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:52.468886 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-804edd1f-93ae-473a-95b2-be727032232e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:52.469695 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-804edd1f-93ae-473a-95b2-be727032232e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:52.478309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-804edd1f-93ae-473a-95b2-be727032232e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:52.479136 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-804edd1f-93ae-473a-95b2-be727032232e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:52.480115 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-804edd1f-93ae-473a-95b2-be727032232e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:52.480558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-804edd1f-93ae-473a-95b2-be727032232e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:52.515743 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-804edd1f-93ae-473a-95b2-be727032232e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:52.516267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-804edd1f-93ae-473a-95b2-be727032232e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:52.516781 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-804edd1f-93ae-473a-95b2-be727032232e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lazy-loading 'fault' on Instance uuid a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:45:52.518464 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-952dd40e-0933-4f92-afca-add77225dbdd tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:52.527294 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-952dd40e-0933-4f92-afca-add77225dbdd tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b" status: 200 len: 1558 microversion: 2.1 time: 0.168935 Jul 01 16:45:52.528133 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 349/687] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:52 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:52.544757 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b03f676f-d46f-449b-930e-1ead0d907c20 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:52.545257 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b03f676f-d46f-449b-930e-1ead0d907c20 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:52.551315 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b03f676f-d46f-449b-930e-1ead0d907c20 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:52.551778 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b03f676f-d46f-449b-930e-1ead0d907c20 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:52.552541 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b03f676f-d46f-449b-930e-1ead0d907c20 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:52.553151 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b03f676f-d46f-449b-930e-1ead0d907c20 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:52.561427 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-804edd1f-93ae-473a-95b2-be727032232e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:52.568311 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-804edd1f-93ae-473a-95b2-be727032232e tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 200 len: 1311 microversion: 2.1 time: 0.104446 Jul 01 16:45:52.569503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 339/688] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:52 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:52.634075 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b03f676f-d46f-449b-930e-1ead0d907c20 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093201 Jul 01 16:45:52.634716 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 350/689] 10.222.0.57 () {58 vars in 1274 bytes} [Fri Jul 1 16:45:52 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:45:53.586318 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5b51bd79-ad07-4a5b-b1c6-a4a0559ad4b4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:53.587375 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5b51bd79-ad07-4a5b-b1c6-a4a0559ad4b4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:53.594325 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5b51bd79-ad07-4a5b-b1c6-a4a0559ad4b4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:53.594823 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5b51bd79-ad07-4a5b-b1c6-a4a0559ad4b4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:53.595593 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5b51bd79-ad07-4a5b-b1c6-a4a0559ad4b4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:53.596032 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5b51bd79-ad07-4a5b-b1c6-a4a0559ad4b4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:53.609527 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-5b51bd79-ad07-4a5b-b1c6-a4a0559ad4b4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] HTTP exception thrown: Instance a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 could not be found. Jul 01 16:45:53.611255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5b51bd79-ad07-4a5b-b1c6-a4a0559ad4b4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Request method failure captured: Jul 01 16:45:53.611255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 HTTP/1.1 Jul 01 16:45:53.611255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:45:53.611255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:45:53.611255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:45:53.611255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:45:53.611255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:45:53.611255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:45:53.611255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:45:53.611255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:45:53.611255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyOI-s3iPDB4YLflXSSRZWcau0vhHiVagbazYRJFMf9-OokthaqI0R_YfsAgJ8HN57hiV6pLMlhwp8sGg5hnPn2V7hGYaEstnvtMh8Gwcl3eCgjot-5oXe0pZAz2Wj1DG2Utw8Q4W96USbDVD_e5F1KghjdjHfBU_BAZG2dmgSw5D10 Jul 01 16:45:53.611255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:45:53.611255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:45:53.611255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:45:53.611255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:45:53.611255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:45:53.611255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:45:53.611255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: bf55d220c94d4445af9f73c532029e42 Jul 01 16:45:53.611255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1802263634 Jul 01 16:45:53.611255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:45:53.611255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:45:53.612723 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bf55d220c94d4445af9f73c532029e42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bf55d220c94d4445af9f73c532029e42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bf55d220c94d4445af9f73c532029e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bf55d220c94d4445af9f73c532029e42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:45:53.612723 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1802263634 Jul 01 16:45:53.612723 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: bf55d220c94d4445af9f73c532029e42 Jul 01 16:45:53.612723 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1802263634 Jul 01 16:45:53.612723 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-ServerRescueNegativeTestJSON-1802263634-project Jul 01 16:45:53.612723 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:45:53.612723 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:45:53.612723 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: 71c383c04f9543d8ab97a6c0db268ca5 Jul 01 16:45:53.612723 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1802263634-project Jul 01 16:45:53.612723 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:45:53.612723 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 could not be found. Jul 01 16:45:53.612723 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': 'a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5'} Jul 01 16:45:53.613508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:45:53.613508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:45:53.613508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:45:53.613508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:45:53.613508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:45:53.613508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:45:53.613508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:45:53.613508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:45:53.613508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:45:53.613508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:45:53.613508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 could not be found. Jul 01 16:45:53.613508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:53.613508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:45:53.613508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:53.613508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:45:53.613508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:45:53.613508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:45:53.613508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:45:53.613508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:45:53.613508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:45:53.614746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:45:53.614746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:45:53.614746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:45:53.614746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:45:53.614746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:45:53.614746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:45:53.614746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:45:53.614746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 could not be found. Jul 01 16:45:53.614746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:53.614746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:45:53.614746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:53.614746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:45:53.614746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:45:53.614746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:45:53.614746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:45:53.614746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:45:53.614746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 could not be found. Jul 01 16:45:53.614746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:53.616660 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5b51bd79-ad07-4a5b-b1c6-a4a0559ad4b4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Returning 404 to user: Instance a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:45:53.616660 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5b51bd79-ad07-4a5b-b1c6-a4a0559ad4b4 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5" status: 404 len: 111 microversion: 2.1 time: 0.030586 Jul 01 16:45:53.616660 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 340/690] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:53 2022] GET /compute/v2.1/servers/a7f23e92-6b5e-4dbc-8ae1-5b1fcbccacb5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:45:53.623062 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4650b334-1bd1-46e0-a247-921cda3d425b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:53.624078 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4650b334-1bd1-46e0-a247-921cda3d425b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:53.631917 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4650b334-1bd1-46e0-a247-921cda3d425b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:53.632369 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4650b334-1bd1-46e0-a247-921cda3d425b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:53.633151 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4650b334-1bd1-46e0-a247-921cda3d425b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:53.633587 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4650b334-1bd1-46e0-a247-921cda3d425b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:53.664966 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4650b334-1bd1-46e0-a247-921cda3d425b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 16:45:53.767383 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4650b334-1bd1-46e0-a247-921cda3d425b tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 204 len: 0 microversion: 2.1 time: 0.148607 Jul 01 16:45:53.770442 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 351/691] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:45:53 2022] DELETE /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 16:45:53.779648 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2084aab9-6c99-46db-b6c2-19185d8f8b3a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:53.780436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2084aab9-6c99-46db-b6c2-19185d8f8b3a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:53.789094 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2084aab9-6c99-46db-b6c2-19185d8f8b3a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:53.789601 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2084aab9-6c99-46db-b6c2-19185d8f8b3a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:53.790581 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2084aab9-6c99-46db-b6c2-19185d8f8b3a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:53.791022 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2084aab9-6c99-46db-b6c2-19185d8f8b3a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:53.805499 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-1468eef0-2b6f-4a03-949f-65718b147a75 req-6b9f9750-6640-4cf4-80d9-487b141e97e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "065f34be-ae7e-43dc-8ff4-9656de8e4f9b", "tag": "e1d9786d-77cd-467e-a907-5d453b790339"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:53.813568 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-1468eef0-2b6f-4a03-949f-65718b147a75 req-6b9f9750-6640-4cf4-80d9-487b141e97e0 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:53.813993 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-1468eef0-2b6f-4a03-949f-65718b147a75 req-6b9f9750-6640-4cf4-80d9-487b141e97e0 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:53.825758 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-1468eef0-2b6f-4a03-949f-65718b147a75 req-6b9f9750-6640-4cf4-80d9-487b141e97e0 service nova] Creating event network-changed:e1d9786d-77cd-467e-a907-5d453b790339 for instance 065f34be-ae7e-43dc-8ff4-9656de8e4f9b on hv-cinder-79760 Jul 01 16:45:53.830736 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-1468eef0-2b6f-4a03-949f-65718b147a75 req-6b9f9750-6640-4cf4-80d9-487b141e97e0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029764 Jul 01 16:45:53.831523 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 352/692] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:45:53.943911 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2084aab9-6c99-46db-b6c2-19185d8f8b3a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:53.946098 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=100 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:45:53.952883 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2084aab9-6c99-46db-b6c2-19185d8f8b3a tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.179064 Jul 01 16:45:53.953456 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 341/693] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:53 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:54.972211 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-897c1a9d-7296-48cc-94ff-7276d687f761 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:54.972903 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-897c1a9d-7296-48cc-94ff-7276d687f761 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:54.979120 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-897c1a9d-7296-48cc-94ff-7276d687f761 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:54.979561 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-897c1a9d-7296-48cc-94ff-7276d687f761 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:54.980313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-897c1a9d-7296-48cc-94ff-7276d687f761 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:54.980747 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-897c1a9d-7296-48cc-94ff-7276d687f761 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:55.112241 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-897c1a9d-7296-48cc-94ff-7276d687f761 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:55.120187 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-897c1a9d-7296-48cc-94ff-7276d687f761 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.152717 Jul 01 16:45:55.120776 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 353/694] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:54 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:55.959380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3077e63e-d9e0-4a6a-ac12-c23aae1cb457 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:55.959952 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3077e63e-d9e0-4a6a-ac12-c23aae1cb457 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:55.965943 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3077e63e-d9e0-4a6a-ac12-c23aae1cb457 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:55.966416 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3077e63e-d9e0-4a6a-ac12-c23aae1cb457 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:55.967172 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3077e63e-d9e0-4a6a-ac12-c23aae1cb457 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:55.967605 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3077e63e-d9e0-4a6a-ac12-c23aae1cb457 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:55.989870 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3077e63e-d9e0-4a6a-ac12-c23aae1cb457 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad/ips" status: 200 len: 152 microversion: 2.20 time: 0.139286 Jul 01 16:45:55.990937 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 342/695] 10.222.0.57 () {60 vars in 1288 bytes} [Fri Jul 1 16:45:55 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad/ips => generated 152 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 16:45:56.137006 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b1981c6b-b06b-48a5-a155-3407a8bdf65c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:56.137616 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b1981c6b-b06b-48a5-a155-3407a8bdf65c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:56.144656 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b1981c6b-b06b-48a5-a155-3407a8bdf65c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:56.145175 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b1981c6b-b06b-48a5-a155-3407a8bdf65c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:56.145944 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b1981c6b-b06b-48a5-a155-3407a8bdf65c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:56.146414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b1981c6b-b06b-48a5-a155-3407a8bdf65c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:56.295984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b1981c6b-b06b-48a5-a155-3407a8bdf65c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:56.304331 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b1981c6b-b06b-48a5-a155-3407a8bdf65c tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.171150 Jul 01 16:45:56.304906 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 354/696] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:56 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:57.321611 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4643d702-7c89-475e-92b3-5d29d9c93dc9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:57.322133 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4643d702-7c89-475e-92b3-5d29d9c93dc9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:57.328814 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4643d702-7c89-475e-92b3-5d29d9c93dc9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:57.329255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4643d702-7c89-475e-92b3-5d29d9c93dc9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:57.330013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4643d702-7c89-475e-92b3-5d29d9c93dc9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:57.330470 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4643d702-7c89-475e-92b3-5d29d9c93dc9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:57.542058 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4643d702-7c89-475e-92b3-5d29d9c93dc9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:57.550366 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4643d702-7c89-475e-92b3-5d29d9c93dc9 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1523 microversion: 2.1 time: 0.232735 Jul 01 16:45:57.551040 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 343/697] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:57 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:57.910369 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-bbe8ed34-6ef6-4686-9942-d908a7d36408 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:57.910996 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-bbe8ed34-6ef6-4686-9942-d908a7d36408 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:57.917517 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bbe8ed34-6ef6-4686-9942-d908a7d36408 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:57.918038 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bbe8ed34-6ef6-4686-9942-d908a7d36408 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:57.918919 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bbe8ed34-6ef6-4686-9942-d908a7d36408 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:57.919423 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bbe8ed34-6ef6-4686-9942-d908a7d36408 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:57.933395 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-4998f198-0cca-43b3-900c-f2613eb1542d req-568a0422-30fd-494e-b455-dd21d263b2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccdab81c-96e6-4936-8bd6-fe8a3ea5e956", "name": "network-vif-deleted", "tag": "6734072e-1ee7-4702-af2c-30d3cd1f8189"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:45:57.941710 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-4998f198-0cca-43b3-900c-f2613eb1542d req-568a0422-30fd-494e-b455-dd21d263b2b0 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:57.942226 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-4998f198-0cca-43b3-900c-f2613eb1542d req-568a0422-30fd-494e-b455-dd21d263b2b0 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:57.943871 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-bbe8ed34-6ef6-4686-9942-d908a7d36408 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lazy-loading 'flavor' on Instance uuid d8d5cf19-9bb2-4534-8076-564fb7538cad {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:45:57.954888 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-4998f198-0cca-43b3-900c-f2613eb1542d req-568a0422-30fd-494e-b455-dd21d263b2b0 service nova] Creating event network-vif-deleted:6734072e-1ee7-4702-af2c-30d3cd1f8189 for instance ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 on hv-cinder-79760 Jul 01 16:45:57.960491 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-4998f198-0cca-43b3-900c-f2613eb1542d req-568a0422-30fd-494e-b455-dd21d263b2b0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089931 Jul 01 16:45:57.961186 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 355/698] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:45:58.210116 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-bbe8ed34-6ef6-4686-9942-d908a7d36408 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "POST /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad/action" status: 202 len: 0 microversion: 2.20 time: 0.302842 Jul 01 16:45:58.210815 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 344/699] 10.222.0.57 () {62 vars in 1318 bytes} [Fri Jul 1 16:45:57 2022] POST /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 16:45:58.219513 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e0f0f0d5-355d-43d9-9c6d-5ff4c8463a56 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:58.220220 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e0f0f0d5-355d-43d9-9c6d-5ff4c8463a56 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:58.227204 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e0f0f0d5-355d-43d9-9c6d-5ff4c8463a56 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:58.227555 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e0f0f0d5-355d-43d9-9c6d-5ff4c8463a56 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:58.228380 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e0f0f0d5-355d-43d9-9c6d-5ff4c8463a56 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:58.228826 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e0f0f0d5-355d-43d9-9c6d-5ff4c8463a56 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:58.371720 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e0f0f0d5-355d-43d9-9c6d-5ff4c8463a56 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:58.380103 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e0f0f0d5-355d-43d9-9c6d-5ff4c8463a56 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:58.382437 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e0f0f0d5-355d-43d9-9c6d-5ff4c8463a56 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:58.383799 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e0f0f0d5-355d-43d9-9c6d-5ff4c8463a56 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1723 microversion: 2.20 time: 0.168482 Jul 01 16:45:58.384413 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 356/700] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:45:58 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:45:58.568679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5d441e9c-ff80-419d-84a7-7906ba3f4093 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:58.569483 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5d441e9c-ff80-419d-84a7-7906ba3f4093 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:58.576092 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5d441e9c-ff80-419d-84a7-7906ba3f4093 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:58.576583 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5d441e9c-ff80-419d-84a7-7906ba3f4093 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:58.577404 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5d441e9c-ff80-419d-84a7-7906ba3f4093 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:58.577840 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5d441e9c-ff80-419d-84a7-7906ba3f4093 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:58.613403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5d441e9c-ff80-419d-84a7-7906ba3f4093 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:58.614117 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5d441e9c-ff80-419d-84a7-7906ba3f4093 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:58.614762 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-5d441e9c-ff80-419d-84a7-7906ba3f4093 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lazy-loading 'fault' on Instance uuid ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:45:58.656768 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5d441e9c-ff80-419d-84a7-7906ba3f4093 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c383c04f9543d8ab97a6c0db268ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf55d220c94d4445af9f73c532029e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:58.664848 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5d441e9c-ff80-419d-84a7-7906ba3f4093 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 200 len: 1312 microversion: 2.1 time: 0.100890 Jul 01 16:45:58.665418 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 345/701] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:58 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:45:59.405392 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-36ae0606-ea6e-4db5-9c2c-1ed15a6c4aea tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:59.406001 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-36ae0606-ea6e-4db5-9c2c-1ed15a6c4aea tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:59.413120 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-36ae0606-ea6e-4db5-9c2c-1ed15a6c4aea tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:59.413568 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-36ae0606-ea6e-4db5-9c2c-1ed15a6c4aea tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:59.414336 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-36ae0606-ea6e-4db5-9c2c-1ed15a6c4aea tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:59.414797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-36ae0606-ea6e-4db5-9c2c-1ed15a6c4aea tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:59.544975 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-36ae0606-ea6e-4db5-9c2c-1ed15a6c4aea tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:59.553128 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-36ae0606-ea6e-4db5-9c2c-1ed15a6c4aea tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:59.554420 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-36ae0606-ea6e-4db5-9c2c-1ed15a6c4aea tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:45:59.555583 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-36ae0606-ea6e-4db5-9c2c-1ed15a6c4aea tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1723 microversion: 2.20 time: 0.154126 Jul 01 16:45:59.556149 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 357/702] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:45:59 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:45:59.686219 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-28815a8f-f7bb-4bcb-9745-bb0b8d0d7874 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:45:59.686790 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-28815a8f-f7bb-4bcb-9745-bb0b8d0d7874 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] [instance: ccdab81c-96e6-4936-8bd6-fe8a3ea5e956] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:45:59.693346 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-28815a8f-f7bb-4bcb-9745-bb0b8d0d7874 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:59.693784 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-28815a8f-f7bb-4bcb-9745-bb0b8d0d7874 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:59.694564 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-28815a8f-f7bb-4bcb-9745-bb0b8d0d7874 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:45:59.694991 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-28815a8f-f7bb-4bcb-9745-bb0b8d0d7874 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:45:59.707948 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-28815a8f-f7bb-4bcb-9745-bb0b8d0d7874 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] HTTP exception thrown: Instance ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 could not be found. Jul 01 16:45:59.710625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-28815a8f-f7bb-4bcb-9745-bb0b8d0d7874 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Request method failure captured: Jul 01 16:45:59.710625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 HTTP/1.1 Jul 01 16:45:59.710625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:45:59.710625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:45:59.710625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:45:59.710625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:45:59.710625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:45:59.710625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:45:59.710625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:45:59.710625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:45:59.710625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyOI-s3iPDB4YLflXSSRZWcau0vhHiVagbazYRJFMf9-OokthaqI0R_YfsAgJ8HN57hiV6pLMlhwp8sGg5hnPn2V7hGYaEstnvtMh8Gwcl3eCgjot-5oXe0pZAz2Wj1DG2Utw8Q4W96USbDVD_e5F1KghjdjHfBU_BAZG2dmgSw5D10 Jul 01 16:45:59.710625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:45:59.710625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:45:59.710625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:45:59.710625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:45:59.710625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:45:59.710625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:45:59.710625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: bf55d220c94d4445af9f73c532029e42 Jul 01 16:45:59.710625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1802263634 Jul 01 16:45:59.710625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:45:59.710625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:45:59.712203 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bf55d220c94d4445af9f73c532029e42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bf55d220c94d4445af9f73c532029e42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bf55d220c94d4445af9f73c532029e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bf55d220c94d4445af9f73c532029e42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:45:59.712203 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1802263634 Jul 01 16:45:59.712203 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: bf55d220c94d4445af9f73c532029e42 Jul 01 16:45:59.712203 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1802263634 Jul 01 16:45:59.712203 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-ServerRescueNegativeTestJSON-1802263634-project Jul 01 16:45:59.712203 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:45:59.712203 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:45:59.712203 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: 71c383c04f9543d8ab97a6c0db268ca5 Jul 01 16:45:59.712203 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1802263634-project Jul 01 16:45:59.712203 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:45:59.712203 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 could not be found. Jul 01 16:45:59.712203 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': 'ccdab81c-96e6-4936-8bd6-fe8a3ea5e956'} Jul 01 16:45:59.713074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:45:59.713074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:45:59.713074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:45:59.713074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:45:59.713074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:45:59.713074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:45:59.713074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:45:59.713074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:45:59.713074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:45:59.713074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:45:59.713074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 could not be found. Jul 01 16:45:59.713074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:59.713074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:45:59.713074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:59.713074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:45:59.713074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:45:59.713074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:45:59.713074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:45:59.713074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:45:59.713074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:45:59.714533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:45:59.714533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:45:59.714533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:45:59.714533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:45:59.714533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:45:59.714533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:45:59.714533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:45:59.714533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 could not be found. Jul 01 16:45:59.714533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:59.714533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:45:59.714533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:59.714533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:45:59.714533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:45:59.714533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:45:59.714533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:45:59.714533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:45:59.714533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 could not be found. Jul 01 16:45:59.714533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:45:59.715801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-28815a8f-f7bb-4bcb-9745-bb0b8d0d7874 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] Returning 404 to user: Instance ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:45:59.715801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-28815a8f-f7bb-4bcb-9745-bb0b8d0d7874 tempest-ServerRescueNegativeTestJSON-1802263634 tempest-ServerRescueNegativeTestJSON-1802263634-project] 10.222.0.57 "GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956" status: 404 len: 111 microversion: 2.1 time: 0.034885 Jul 01 16:45:59.715801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 346/703] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:45:59 2022] GET /compute/v2.1/servers/ccdab81c-96e6-4936-8bd6-fe8a3ea5e956 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:46:00.575067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0a913561-5d4d-49b6-9d5b-01d8bc14b372 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:00.575679 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0a913561-5d4d-49b6-9d5b-01d8bc14b372 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:00.582264 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0a913561-5d4d-49b6-9d5b-01d8bc14b372 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:00.582747 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0a913561-5d4d-49b6-9d5b-01d8bc14b372 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:00.584145 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0a913561-5d4d-49b6-9d5b-01d8bc14b372 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:00.584838 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0a913561-5d4d-49b6-9d5b-01d8bc14b372 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:00.727151 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0a913561-5d4d-49b6-9d5b-01d8bc14b372 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:00.737002 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0a913561-5d4d-49b6-9d5b-01d8bc14b372 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:00.738830 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0a913561-5d4d-49b6-9d5b-01d8bc14b372 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:00.741227 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0a913561-5d4d-49b6-9d5b-01d8bc14b372 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1723 microversion: 2.20 time: 0.169251 Jul 01 16:46:00.742777 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 358/704] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:00 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:01.763030 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-92b2ba00-7b4d-4353-9c05-2f51ebf4fa0c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:01.763840 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-92b2ba00-7b4d-4353-9c05-2f51ebf4fa0c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:01.770831 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-92b2ba00-7b4d-4353-9c05-2f51ebf4fa0c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:01.771818 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-92b2ba00-7b4d-4353-9c05-2f51ebf4fa0c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:01.772601 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-92b2ba00-7b4d-4353-9c05-2f51ebf4fa0c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:01.773217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-92b2ba00-7b4d-4353-9c05-2f51ebf4fa0c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:01.938856 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-92b2ba00-7b4d-4353-9c05-2f51ebf4fa0c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:01.947819 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-92b2ba00-7b4d-4353-9c05-2f51ebf4fa0c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:01.949505 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-92b2ba00-7b4d-4353-9c05-2f51ebf4fa0c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:01.950701 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-92b2ba00-7b4d-4353-9c05-2f51ebf4fa0c tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1723 microversion: 2.20 time: 0.194420 Jul 01 16:46:01.951262 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 347/705] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:01 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:02.969433 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5b54dd89-37a3-4411-8d16-89312e4fc4d2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:02.970729 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5b54dd89-37a3-4411-8d16-89312e4fc4d2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:02.978148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5b54dd89-37a3-4411-8d16-89312e4fc4d2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:02.983118 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5b54dd89-37a3-4411-8d16-89312e4fc4d2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:02.984002 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5b54dd89-37a3-4411-8d16-89312e4fc4d2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:02.984424 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5b54dd89-37a3-4411-8d16-89312e4fc4d2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:03.132620 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5b54dd89-37a3-4411-8d16-89312e4fc4d2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:03.141146 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5b54dd89-37a3-4411-8d16-89312e4fc4d2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:03.142415 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5b54dd89-37a3-4411-8d16-89312e4fc4d2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:03.143632 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5b54dd89-37a3-4411-8d16-89312e4fc4d2 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1723 microversion: 2.20 time: 0.178434 Jul 01 16:46:03.144185 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 359/706] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:02 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:04.161871 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-419f6883-aab8-4b23-b1c1-2fb7eec036e4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:04.162693 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-419f6883-aab8-4b23-b1c1-2fb7eec036e4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:04.169347 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-419f6883-aab8-4b23-b1c1-2fb7eec036e4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:04.169796 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-419f6883-aab8-4b23-b1c1-2fb7eec036e4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:04.170588 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-419f6883-aab8-4b23-b1c1-2fb7eec036e4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:04.171023 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-419f6883-aab8-4b23-b1c1-2fb7eec036e4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:04.313258 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-419f6883-aab8-4b23-b1c1-2fb7eec036e4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:04.323610 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-419f6883-aab8-4b23-b1c1-2fb7eec036e4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:04.325100 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-419f6883-aab8-4b23-b1c1-2fb7eec036e4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:04.326257 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-419f6883-aab8-4b23-b1c1-2fb7eec036e4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1723 microversion: 2.20 time: 0.168327 Jul 01 16:46:04.326841 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 348/707] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:04 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:05.344540 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-77fe2e98-89ad-4218-8269-8316528ecc5d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:05.345133 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-77fe2e98-89ad-4218-8269-8316528ecc5d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:05.353017 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-77fe2e98-89ad-4218-8269-8316528ecc5d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:05.353466 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-77fe2e98-89ad-4218-8269-8316528ecc5d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:05.354233 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-77fe2e98-89ad-4218-8269-8316528ecc5d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:05.354701 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-77fe2e98-89ad-4218-8269-8316528ecc5d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:05.357332 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:46:05.463225 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-af5fcb5c-1174-4142-b531-07e3e843a76b tempest-VolumesTestJSON-1753780364 tempest-VolumesTestJSON-1753780364-project] Calling method '.version_select at 0x7fa86c3c7550>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:05.497342 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-77fe2e98-89ad-4218-8269-8316528ecc5d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:05.505825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-77fe2e98-89ad-4218-8269-8316528ecc5d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:05.507403 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-77fe2e98-89ad-4218-8269-8316528ecc5d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:05.508576 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-77fe2e98-89ad-4218-8269-8316528ecc5d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1723 microversion: 2.20 time: 0.167896 Jul 01 16:46:05.509201 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 360/708] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:05 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:05.510490 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-af5fcb5c-1174-4142-b531-07e3e843a76b tempest-VolumesTestJSON-1753780364 tempest-VolumesTestJSON-1753780364-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/fe4e8184-467a-4bb4-a2b8-2fcdd4c9a123" status: 200 len: 350 microversion: 2.1 time: 0.051685 Jul 01 16:46:05.511058 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 349/709] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 1 16:46:05 2022] GET /compute/v2.1/os-volumes/fe4e8184-467a-4bb4-a2b8-2fcdd4c9a123 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:46:06.527230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b529f66f-605b-47f5-960e-e0ad9d649b32 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:06.527841 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b529f66f-605b-47f5-960e-e0ad9d649b32 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:06.534302 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b529f66f-605b-47f5-960e-e0ad9d649b32 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:06.534783 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b529f66f-605b-47f5-960e-e0ad9d649b32 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:06.535550 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b529f66f-605b-47f5-960e-e0ad9d649b32 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:06.535988 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b529f66f-605b-47f5-960e-e0ad9d649b32 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:06.679236 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b529f66f-605b-47f5-960e-e0ad9d649b32 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:06.687150 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b529f66f-605b-47f5-960e-e0ad9d649b32 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:06.688680 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b529f66f-605b-47f5-960e-e0ad9d649b32 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:06.689843 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b529f66f-605b-47f5-960e-e0ad9d649b32 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1723 microversion: 2.20 time: 0.166589 Jul 01 16:46:06.690423 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 361/710] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:06 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:06.826289 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e59ad5ea-cadd-47f8-a623-6426bf5aa05f tempest-VolumesTestJSON-1753780364 tempest-VolumesTestJSON-1753780364-project] Calling method '.version_select at 0x7fa86c37fe50>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:06.874613 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e59ad5ea-cadd-47f8-a623-6426bf5aa05f tempest-VolumesTestJSON-1753780364 tempest-VolumesTestJSON-1753780364-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/b1387b55-4f11-41e7-ba46-5638c87e39b7" status: 200 len: 351 microversion: 2.1 time: 0.052405 Jul 01 16:46:06.875173 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 350/711] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 1 16:46:06 2022] GET /compute/v2.1/os-volumes/b1387b55-4f11-41e7-ba46-5638c87e39b7 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:46:07.708164 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-668c86ad-5723-42d1-8819-750d15b63504 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:07.709653 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-668c86ad-5723-42d1-8819-750d15b63504 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:07.716166 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-668c86ad-5723-42d1-8819-750d15b63504 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:07.716618 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-668c86ad-5723-42d1-8819-750d15b63504 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:07.717385 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-668c86ad-5723-42d1-8819-750d15b63504 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:07.717823 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-668c86ad-5723-42d1-8819-750d15b63504 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:07.848936 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-668c86ad-5723-42d1-8819-750d15b63504 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:07.857606 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-668c86ad-5723-42d1-8819-750d15b63504 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:07.859174 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-668c86ad-5723-42d1-8819-750d15b63504 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:07.860328 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-668c86ad-5723-42d1-8819-750d15b63504 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1723 microversion: 2.20 time: 0.156115 Jul 01 16:46:07.860882 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 362/712] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:07 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:08.203746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-fb332dc7-a16d-44df-a6e5-3b4fd2f284ab tempest-VolumesTestJSON-1753780364 tempest-VolumesTestJSON-1753780364-project] Calling method '.version_select at 0x7fa86c3bef70>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:08.250080 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-fb332dc7-a16d-44df-a6e5-3b4fd2f284ab tempest-VolumesTestJSON-1753780364 tempest-VolumesTestJSON-1753780364-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/634359ef-3b55-4819-adc5-dcb9f49c1ee0" status: 200 len: 351 microversion: 2.1 time: 0.050470 Jul 01 16:46:08.250689 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 351/713] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 1 16:46:08 2022] GET /compute/v2.1/os-volumes/634359ef-3b55-4819-adc5-dcb9f49c1ee0 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:46:08.262015 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-abb81bec-8276-46e0-a81a-f58cc9c5bc9b tempest-VolumesTestJSON-1753780364 tempest-VolumesTestJSON-1753780364-project] Calling method '.version_select at 0x7fa85f2913a0>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:08.343109 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-abb81bec-8276-46e0-a81a-f58cc9c5bc9b tempest-VolumesTestJSON-1753780364 tempest-VolumesTestJSON-1753780364-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084736 Jul 01 16:46:08.343688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 363/714] 10.222.0.57 () {58 vars in 1133 bytes} [Fri Jul 1 16:46:08 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:08.356175 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-557b0ecc-0661-457e-8e04-241bf253433e tempest-VolumesTestJSON-1753780364 tempest-VolumesTestJSON-1753780364-project] Calling method '.version_select at 0x7fa86c37f430>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:08.437665 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-557b0ecc-0661-457e-8e04-241bf253433e tempest-VolumesTestJSON-1753780364 tempest-VolumesTestJSON-1753780364-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085108 Jul 01 16:46:08.438232 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 352/715] 10.222.0.57 () {58 vars in 1148 bytes} [Fri Jul 1 16:46:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:46:08.450023 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-bf2fc43b-b9f0-4da2-8b02-f530284e7dfe tempest-VolumesTestJSON-1753780364 tempest-VolumesTestJSON-1753780364-project] Calling method '.version_select at 0x7fa85f217040>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:08.681553 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-bf2fc43b-b9f0-4da2-8b02-f530284e7dfe tempest-VolumesTestJSON-1753780364 tempest-VolumesTestJSON-1753780364-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.235265 Jul 01 16:46:08.682191 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 364/716] 10.222.0.57 () {58 vars in 1133 bytes} [Fri Jul 1 16:46:08 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:08.693783 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8e56a434-f0fe-40e4-827a-ad5496439b8b tempest-VolumesTestJSON-1753780364 tempest-VolumesTestJSON-1753780364-project] Calling method '.version_select at 0x7fa86c3c7d30>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:08.774180 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8e56a434-f0fe-40e4-827a-ad5496439b8b tempest-VolumesTestJSON-1753780364 tempest-VolumesTestJSON-1753780364-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084702 Jul 01 16:46:08.774790 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 353/717] 10.222.0.57 () {58 vars in 1166 bytes} [Fri Jul 1 16:46:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:46:08.786880 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e8e7fe17-74c9-416a-a5c0-d97cdf9813e5 tempest-VolumesTestJSON-1753780364 tempest-VolumesTestJSON-1753780364-project] Calling method '.version_select at 0x7fa85f22faf0>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:08.873457 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e8e7fe17-74c9-416a-a5c0-d97cdf9813e5 tempest-VolumesTestJSON-1753780364 tempest-VolumesTestJSON-1753780364-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.090785 Jul 01 16:46:08.873964 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 365/718] 10.222.0.57 () {58 vars in 1169 bytes} [Fri Jul 1 16:46:08 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:46:08.878600 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-aec196d6-1b53-4dfa-ba2f-31882eaecbfa tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:08.879324 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-aec196d6-1b53-4dfa-ba2f-31882eaecbfa tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:08.882528 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:46:08.886326 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9a46940d-6909-4fba-aa33-7d63485b8eab tempest-VolumesTestJSON-1753780364 tempest-VolumesTestJSON-1753780364-project] Calling method '.version_select at 0x7fa85f363a60>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:08.888852 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aec196d6-1b53-4dfa-ba2f-31882eaecbfa tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:08.889296 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aec196d6-1b53-4dfa-ba2f-31882eaecbfa tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:08.890086 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aec196d6-1b53-4dfa-ba2f-31882eaecbfa tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:08.890549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aec196d6-1b53-4dfa-ba2f-31882eaecbfa tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:08.980650 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9a46940d-6909-4fba-aa33-7d63485b8eab tempest-VolumesTestJSON-1753780364 tempest-VolumesTestJSON-1753780364-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.097959 Jul 01 16:46:08.981928 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 366/719] 10.222.0.57 () {58 vars in 1154 bytes} [Fri Jul 1 16:46:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:46:08.997960 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a98cb3d3-5095-4d1c-a2df-b1b36c4b4d4d tempest-VolumesTestJSON-1753780364 tempest-VolumesTestJSON-1753780364-project] Calling method '.version_select at 0x7fa85f2e0c10>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:09.041047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-aec196d6-1b53-4dfa-ba2f-31882eaecbfa tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:09.049056 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-aec196d6-1b53-4dfa-ba2f-31882eaecbfa tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:09.050566 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-aec196d6-1b53-4dfa-ba2f-31882eaecbfa tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:09.051792 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-aec196d6-1b53-4dfa-ba2f-31882eaecbfa tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1723 microversion: 2.20 time: 0.177134 Jul 01 16:46:09.052850 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 354/720] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:08 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:46:09.081207 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a98cb3d3-5095-4d1c-a2df-b1b36c4b4d4d tempest-VolumesTestJSON-1753780364 tempest-VolumesTestJSON-1753780364-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088823 Jul 01 16:46:09.081779 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 367/721] 10.222.0.57 () {58 vars in 1187 bytes} [Fri Jul 1 16:46:08 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:46:09.094108 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-fda94aff-9b14-4936-b7a7-84f9d79f8b97 tempest-VolumesTestJSON-1753780364 tempest-VolumesTestJSON-1753780364-project] Calling method '.version_select at 0x7fa86c41eaf0>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:09.173210 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-fda94aff-9b14-4936-b7a7-84f9d79f8b97 tempest-VolumesTestJSON-1753780364 tempest-VolumesTestJSON-1753780364-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.082740 Jul 01 16:46:09.173771 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 355/722] 10.222.0.57 () {58 vars in 1154 bytes} [Fri Jul 1 16:46:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:10.071321 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-efd8aae8-950b-4b69-870b-bc35498262ef tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:10.071924 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-efd8aae8-950b-4b69-870b-bc35498262ef tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:10.074212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:46:10.079478 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-efd8aae8-950b-4b69-870b-bc35498262ef tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:10.079925 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-efd8aae8-950b-4b69-870b-bc35498262ef tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:10.080688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-efd8aae8-950b-4b69-870b-bc35498262ef tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:10.081121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-efd8aae8-950b-4b69-870b-bc35498262ef tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:10.212622 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-efd8aae8-950b-4b69-870b-bc35498262ef tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:10.220364 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-efd8aae8-950b-4b69-870b-bc35498262ef tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:10.221845 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-efd8aae8-950b-4b69-870b-bc35498262ef tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:10.223018 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-efd8aae8-950b-4b69-870b-bc35498262ef tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1723 microversion: 2.20 time: 0.156597 Jul 01 16:46:10.223569 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 368/723] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:10 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:11.241491 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5a31f4c1-e3fc-4581-94f3-2f175ba33e6e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:11.242075 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5a31f4c1-e3fc-4581-94f3-2f175ba33e6e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:11.248832 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5a31f4c1-e3fc-4581-94f3-2f175ba33e6e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:11.249276 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5a31f4c1-e3fc-4581-94f3-2f175ba33e6e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:11.250032 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5a31f4c1-e3fc-4581-94f3-2f175ba33e6e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:11.250497 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5a31f4c1-e3fc-4581-94f3-2f175ba33e6e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:11.381966 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5a31f4c1-e3fc-4581-94f3-2f175ba33e6e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:11.390000 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5a31f4c1-e3fc-4581-94f3-2f175ba33e6e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:11.391527 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5a31f4c1-e3fc-4581-94f3-2f175ba33e6e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:11.392676 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5a31f4c1-e3fc-4581-94f3-2f175ba33e6e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1723 microversion: 2.20 time: 0.155674 Jul 01 16:46:11.393239 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 356/724] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:11 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:12.412174 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-81573bcd-d72a-4b9a-add5-8c12a1a6f16a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:12.412977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-81573bcd-d72a-4b9a-add5-8c12a1a6f16a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:12.419486 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-81573bcd-d72a-4b9a-add5-8c12a1a6f16a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:12.419929 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-81573bcd-d72a-4b9a-add5-8c12a1a6f16a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:12.420681 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-81573bcd-d72a-4b9a-add5-8c12a1a6f16a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:12.421107 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-81573bcd-d72a-4b9a-add5-8c12a1a6f16a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:12.555726 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-81573bcd-d72a-4b9a-add5-8c12a1a6f16a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:12.563669 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-81573bcd-d72a-4b9a-add5-8c12a1a6f16a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:12.565183 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-81573bcd-d72a-4b9a-add5-8c12a1a6f16a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:12.566404 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-81573bcd-d72a-4b9a-add5-8c12a1a6f16a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1723 microversion: 2.20 time: 0.158356 Jul 01 16:46:12.566967 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 369/725] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:12 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:13.586060 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1bd53d59-e7b9-488b-b147-e32d3801d339 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:13.586709 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1bd53d59-e7b9-488b-b147-e32d3801d339 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:13.593412 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1bd53d59-e7b9-488b-b147-e32d3801d339 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:13.593867 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1bd53d59-e7b9-488b-b147-e32d3801d339 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:13.594662 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1bd53d59-e7b9-488b-b147-e32d3801d339 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:13.595110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1bd53d59-e7b9-488b-b147-e32d3801d339 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:13.730960 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1bd53d59-e7b9-488b-b147-e32d3801d339 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:13.740787 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1bd53d59-e7b9-488b-b147-e32d3801d339 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:13.742539 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1bd53d59-e7b9-488b-b147-e32d3801d339 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:13.743826 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1bd53d59-e7b9-488b-b147-e32d3801d339 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1723 microversion: 2.20 time: 0.162353 Jul 01 16:46:13.744456 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 357/726] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:13 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:14.762362 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9288e1b6-c159-405b-9ead-3e0699c60aac tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:14.763015 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9288e1b6-c159-405b-9ead-3e0699c60aac tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:14.769815 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9288e1b6-c159-405b-9ead-3e0699c60aac tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:14.770379 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9288e1b6-c159-405b-9ead-3e0699c60aac tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:14.771832 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9288e1b6-c159-405b-9ead-3e0699c60aac tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:14.772440 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9288e1b6-c159-405b-9ead-3e0699c60aac tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:14.914647 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9288e1b6-c159-405b-9ead-3e0699c60aac tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:14.922706 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9288e1b6-c159-405b-9ead-3e0699c60aac tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:14.924221 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9288e1b6-c159-405b-9ead-3e0699c60aac tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:14.925558 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9288e1b6-c159-405b-9ead-3e0699c60aac tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1744 microversion: 2.20 time: 0.167042 Jul 01 16:46:14.926190 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 370/727] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:14 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:15.947710 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7f9b99bc-3377-4cd3-ad46-c097d30e19eb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:15.948324 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7f9b99bc-3377-4cd3-ad46-c097d30e19eb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:15.956132 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7f9b99bc-3377-4cd3-ad46-c097d30e19eb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:15.956801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7f9b99bc-3377-4cd3-ad46-c097d30e19eb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:15.957726 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7f9b99bc-3377-4cd3-ad46-c097d30e19eb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:15.959127 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7f9b99bc-3377-4cd3-ad46-c097d30e19eb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:16.112948 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7f9b99bc-3377-4cd3-ad46-c097d30e19eb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:16.121627 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7f9b99bc-3377-4cd3-ad46-c097d30e19eb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:16.123169 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7f9b99bc-3377-4cd3-ad46-c097d30e19eb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:16.124331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7f9b99bc-3377-4cd3-ad46-c097d30e19eb tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1744 microversion: 2.20 time: 0.182763 Jul 01 16:46:16.125065 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 358/728] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:15 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1744 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:17.143014 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-49b89755-0233-4e24-a71d-45bb520fe45d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:17.143884 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-49b89755-0233-4e24-a71d-45bb520fe45d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:17.151840 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-49b89755-0233-4e24-a71d-45bb520fe45d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:17.152381 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-49b89755-0233-4e24-a71d-45bb520fe45d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:17.153378 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-49b89755-0233-4e24-a71d-45bb520fe45d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:17.154033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-49b89755-0233-4e24-a71d-45bb520fe45d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:17.328013 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-49b89755-0233-4e24-a71d-45bb520fe45d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:17.339066 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-49b89755-0233-4e24-a71d-45bb520fe45d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:17.341362 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-49b89755-0233-4e24-a71d-45bb520fe45d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:17.343195 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-49b89755-0233-4e24-a71d-45bb520fe45d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1739 microversion: 2.20 time: 0.204820 Jul 01 16:46:17.344471 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 371/729] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:17 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:18.362218 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b13dd66e-aab6-4bc2-8dca-b24329b4bd59 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:18.362960 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b13dd66e-aab6-4bc2-8dca-b24329b4bd59 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:18.373715 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b13dd66e-aab6-4bc2-8dca-b24329b4bd59 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:18.375912 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b13dd66e-aab6-4bc2-8dca-b24329b4bd59 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:18.376952 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b13dd66e-aab6-4bc2-8dca-b24329b4bd59 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:18.384434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b13dd66e-aab6-4bc2-8dca-b24329b4bd59 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:18.393472 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-af6f68d4-3725-4022-90fb-fdd18703a8a1 req-235a70ae-73fb-4604-9aad-65fe36044d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d5cf19-9bb2-4534-8076-564fb7538cad", "name": "network-vif-plugged", "status": "completed", "tag": "ca06c719-80eb-4c4d-b8cd-b06d9b34ab88"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:46:18.412422 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-af6f68d4-3725-4022-90fb-fdd18703a8a1 req-235a70ae-73fb-4604-9aad-65fe36044d44 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:18.413269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-af6f68d4-3725-4022-90fb-fdd18703a8a1 req-235a70ae-73fb-4604-9aad-65fe36044d44 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:18.427736 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-af6f68d4-3725-4022-90fb-fdd18703a8a1 req-235a70ae-73fb-4604-9aad-65fe36044d44 service nova] Creating event network-vif-plugged:ca06c719-80eb-4c4d-b8cd-b06d9b34ab88 for instance d8d5cf19-9bb2-4534-8076-564fb7538cad on hv-cinder-79760 Jul 01 16:46:18.434905 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-af6f68d4-3725-4022-90fb-fdd18703a8a1 req-235a70ae-73fb-4604-9aad-65fe36044d44 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.278284 Jul 01 16:46:18.436770 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 359/730] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:46:18.618444 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b13dd66e-aab6-4bc2-8dca-b24329b4bd59 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:18.627523 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b13dd66e-aab6-4bc2-8dca-b24329b4bd59 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:18.629690 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b13dd66e-aab6-4bc2-8dca-b24329b4bd59 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:18.632050 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b13dd66e-aab6-4bc2-8dca-b24329b4bd59 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1739 microversion: 2.20 time: 0.273095 Jul 01 16:46:18.638880 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 372/731] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:18 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1739 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:46:19.362512 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0a0f9040-131d-4a57-b43d-bef83a79b75f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:46:19.363140 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0a0f9040-131d-4a57-b43d-bef83a79b75f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:19.377094 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0a0f9040-131d-4a57-b43d-bef83a79b75f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:19.377848 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0a0f9040-131d-4a57-b43d-bef83a79b75f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:19.378755 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0a0f9040-131d-4a57-b43d-bef83a79b75f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:19.387140 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0a0f9040-131d-4a57-b43d-bef83a79b75f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:19.419397 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-0a0f9040-131d-4a57-b43d-bef83a79b75f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lazy-loading 'flavor' on Instance uuid 602a9841-5b03-4f60-b3be-7c4efe7cd9ef {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:46:19.532900 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0a0f9040-131d-4a57-b43d-bef83a79b75f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "POST /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef/action" status: 202 len: 0 microversion: 2.1 time: 0.175126 Jul 01 16:46:19.535353 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 360/732] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 1 16:46:19 2022] POST /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:46:19.543992 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1c2657b3-38d7-4544-9f18-605f74fea76e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:19.544609 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1c2657b3-38d7-4544-9f18-605f74fea76e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:19.553647 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1c2657b3-38d7-4544-9f18-605f74fea76e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:19.554501 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1c2657b3-38d7-4544-9f18-605f74fea76e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:19.555463 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1c2657b3-38d7-4544-9f18-605f74fea76e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:19.558595 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1c2657b3-38d7-4544-9f18-605f74fea76e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:19.650921 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ea6012c2-b847-470b-bc9b-8ad0c693052e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:19.651735 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ea6012c2-b847-470b-bc9b-8ad0c693052e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:19.660491 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ea6012c2-b847-470b-bc9b-8ad0c693052e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:19.661175 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ea6012c2-b847-470b-bc9b-8ad0c693052e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:19.662195 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ea6012c2-b847-470b-bc9b-8ad0c693052e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:19.662905 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ea6012c2-b847-470b-bc9b-8ad0c693052e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:19.885981 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-1c2657b3-38d7-4544-9f18-605f74fea76e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:19.890638 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ea6012c2-b847-470b-bc9b-8ad0c693052e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:19.894404 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1c2657b3-38d7-4544-9f18-605f74fea76e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1569 microversion: 2.1 time: 0.354151 Jul 01 16:46:19.904320 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:46:19.904951 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ea6012c2-b847-470b-bc9b-8ad0c693052e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:19.906025 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 373/733] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:19 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1569 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:19.906910 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ea6012c2-b847-470b-bc9b-8ad0c693052e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:19.908192 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ea6012c2-b847-470b-bc9b-8ad0c693052e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1739 microversion: 2.20 time: 0.262379 Jul 01 16:46:19.908863 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 361/734] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:19 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:20.914837 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e4b14262-7ec1-4fa9-8375-709517809a1e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:20.915453 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e4b14262-7ec1-4fa9-8375-709517809a1e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:20.923996 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e4b14262-7ec1-4fa9-8375-709517809a1e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:20.924522 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e4b14262-7ec1-4fa9-8375-709517809a1e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:20.925359 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e4b14262-7ec1-4fa9-8375-709517809a1e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:20.927315 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e4b14262-7ec1-4fa9-8375-709517809a1e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:20.928584 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f8f8b7c2-24ae-4409-a629-a57bfdc69ab0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:20.929859 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f8f8b7c2-24ae-4409-a629-a57bfdc69ab0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:20.937641 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f8f8b7c2-24ae-4409-a629-a57bfdc69ab0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:20.938426 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f8f8b7c2-24ae-4409-a629-a57bfdc69ab0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:20.939649 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f8f8b7c2-24ae-4409-a629-a57bfdc69ab0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:20.940432 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f8f8b7c2-24ae-4409-a629-a57bfdc69ab0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:21.175945 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e4b14262-7ec1-4fa9-8375-709517809a1e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:21.184218 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e4b14262-7ec1-4fa9-8375-709517809a1e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1569 microversion: 2.1 time: 0.274733 Jul 01 16:46:21.194248 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 374/735] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:20 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1569 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:21.201008 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f8f8b7c2-24ae-4409-a629-a57bfdc69ab0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:21.211231 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f8f8b7c2-24ae-4409-a629-a57bfdc69ab0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:21.212728 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f8f8b7c2-24ae-4409-a629-a57bfdc69ab0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:21.213901 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f8f8b7c2-24ae-4409-a629-a57bfdc69ab0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1739 microversion: 2.20 time: 0.290756 Jul 01 16:46:21.214516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 362/736] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:20 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1739 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:46:22.208058 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-74e4deb1-7e58-4ea4-ad5f-94273a46bd28 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:22.208058 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-74e4deb1-7e58-4ea4-ad5f-94273a46bd28 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:22.214655 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-74e4deb1-7e58-4ea4-ad5f-94273a46bd28 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:22.215113 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-74e4deb1-7e58-4ea4-ad5f-94273a46bd28 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:22.216024 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-74e4deb1-7e58-4ea4-ad5f-94273a46bd28 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:22.216628 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-74e4deb1-7e58-4ea4-ad5f-94273a46bd28 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:22.233790 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-71aee8a5-8b7e-412a-9941-fd94495c3f97 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:22.235123 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-71aee8a5-8b7e-412a-9941-fd94495c3f97 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:22.243618 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-71aee8a5-8b7e-412a-9941-fd94495c3f97 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:22.244659 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-71aee8a5-8b7e-412a-9941-fd94495c3f97 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:22.245460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-71aee8a5-8b7e-412a-9941-fd94495c3f97 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:22.246094 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-71aee8a5-8b7e-412a-9941-fd94495c3f97 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:22.440556 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-74e4deb1-7e58-4ea4-ad5f-94273a46bd28 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:22.447943 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-71aee8a5-8b7e-412a-9941-fd94495c3f97 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:22.452583 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-74e4deb1-7e58-4ea4-ad5f-94273a46bd28 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1569 microversion: 2.1 time: 0.255119 Jul 01 16:46:22.453165 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 375/737] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:22 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1569 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:22.457176 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-71aee8a5-8b7e-412a-9941-fd94495c3f97 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:22.459619 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-71aee8a5-8b7e-412a-9941-fd94495c3f97 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:22.460770 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-71aee8a5-8b7e-412a-9941-fd94495c3f97 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1739 microversion: 2.20 time: 0.231103 Jul 01 16:46:22.461325 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 363/738] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:22 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:46:23.475923 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8b780105-1318-42b5-b496-28579bf26ab5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:23.477221 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8b780105-1318-42b5-b496-28579bf26ab5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:23.483362 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6bfa2650-fd57-4d8a-97c2-f2543bf20120 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:23.485301 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6bfa2650-fd57-4d8a-97c2-f2543bf20120 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:23.489588 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8b780105-1318-42b5-b496-28579bf26ab5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:23.490530 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8b780105-1318-42b5-b496-28579bf26ab5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:23.491918 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8b780105-1318-42b5-b496-28579bf26ab5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:23.492800 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8b780105-1318-42b5-b496-28579bf26ab5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:23.494787 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6bfa2650-fd57-4d8a-97c2-f2543bf20120 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:23.495873 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6bfa2650-fd57-4d8a-97c2-f2543bf20120 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:23.496879 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6bfa2650-fd57-4d8a-97c2-f2543bf20120 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:23.497428 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6bfa2650-fd57-4d8a-97c2-f2543bf20120 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:23.715603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8b780105-1318-42b5-b496-28579bf26ab5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:23.730993 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8b780105-1318-42b5-b496-28579bf26ab5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1569 microversion: 2.1 time: 0.259107 Jul 01 16:46:23.731638 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 376/739] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:23 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1569 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:23.744307 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6bfa2650-fd57-4d8a-97c2-f2543bf20120 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:23.754104 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6bfa2650-fd57-4d8a-97c2-f2543bf20120 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:23.756311 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6bfa2650-fd57-4d8a-97c2-f2543bf20120 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:23.757687 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6bfa2650-fd57-4d8a-97c2-f2543bf20120 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1739 microversion: 2.20 time: 0.280931 Jul 01 16:46:23.769121 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 364/740] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:23 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1739 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:24.748996 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-654b5fe1-6714-4c07-896f-ea1c4870793a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:24.749591 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-654b5fe1-6714-4c07-896f-ea1c4870793a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:24.759685 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-654b5fe1-6714-4c07-896f-ea1c4870793a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:24.760497 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-654b5fe1-6714-4c07-896f-ea1c4870793a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:24.761524 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-654b5fe1-6714-4c07-896f-ea1c4870793a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:24.762196 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-654b5fe1-6714-4c07-896f-ea1c4870793a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:24.784393 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-cd4cd0eb-369d-4ba3-9fb5-83674230d9ab tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:24.789308 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-cd4cd0eb-369d-4ba3-9fb5-83674230d9ab tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:24.803206 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cd4cd0eb-369d-4ba3-9fb5-83674230d9ab tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:24.804676 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cd4cd0eb-369d-4ba3-9fb5-83674230d9ab tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:24.807391 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cd4cd0eb-369d-4ba3-9fb5-83674230d9ab tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:24.808043 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cd4cd0eb-369d-4ba3-9fb5-83674230d9ab tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:25.062849 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-cd4cd0eb-369d-4ba3-9fb5-83674230d9ab tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:25.073679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-cd4cd0eb-369d-4ba3-9fb5-83674230d9ab tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:25.075738 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-cd4cd0eb-369d-4ba3-9fb5-83674230d9ab tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:25.077055 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-654b5fe1-6714-4c07-896f-ea1c4870793a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:25.077604 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-cd4cd0eb-369d-4ba3-9fb5-83674230d9ab tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1739 microversion: 2.20 time: 0.303840 Jul 01 16:46:25.086640 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-654b5fe1-6714-4c07-896f-ea1c4870793a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1569 microversion: 2.1 time: 0.340724 Jul 01 16:46:25.088015 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 365/741] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:24 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1739 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:25.090653 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 377/742] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:24 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1569 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:26.099543 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5f050ed8-21aa-4dc1-8079-6c68fedd9059 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:26.100829 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5f050ed8-21aa-4dc1-8079-6c68fedd9059 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:26.102943 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f8cd08a0-2103-459a-a2d5-b19592306234 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:26.103561 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f8cd08a0-2103-459a-a2d5-b19592306234 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:26.111175 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f8cd08a0-2103-459a-a2d5-b19592306234 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:26.111836 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f8cd08a0-2103-459a-a2d5-b19592306234 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:26.112801 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f8cd08a0-2103-459a-a2d5-b19592306234 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:26.113396 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f8cd08a0-2103-459a-a2d5-b19592306234 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:26.117277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5f050ed8-21aa-4dc1-8079-6c68fedd9059 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:26.117967 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5f050ed8-21aa-4dc1-8079-6c68fedd9059 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:26.120315 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5f050ed8-21aa-4dc1-8079-6c68fedd9059 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:26.120763 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5f050ed8-21aa-4dc1-8079-6c68fedd9059 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:26.339666 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f8cd08a0-2103-459a-a2d5-b19592306234 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:26.376396 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f8cd08a0-2103-459a-a2d5-b19592306234 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1569 microversion: 2.1 time: 0.253093 Jul 01 16:46:26.386841 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 378/743] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:26 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1569 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:46:26.421934 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5f050ed8-21aa-4dc1-8079-6c68fedd9059 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:26.434959 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5f050ed8-21aa-4dc1-8079-6c68fedd9059 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:26.436672 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5f050ed8-21aa-4dc1-8079-6c68fedd9059 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:26.438218 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5f050ed8-21aa-4dc1-8079-6c68fedd9059 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1739 microversion: 2.20 time: 0.344404 Jul 01 16:46:26.439096 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 366/744] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:26 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1739 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:27.384487 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3f3df9d4-0bb9-42ea-8201-34afab256cf5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:27.385025 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3f3df9d4-0bb9-42ea-8201-34afab256cf5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:27.391024 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f3df9d4-0bb9-42ea-8201-34afab256cf5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:27.391474 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f3df9d4-0bb9-42ea-8201-34afab256cf5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:27.392338 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f3df9d4-0bb9-42ea-8201-34afab256cf5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:27.392772 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f3df9d4-0bb9-42ea-8201-34afab256cf5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:27.460113 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e2a28e5e-2ad0-4ee4-b2b4-f38141b369ba tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:27.460839 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e2a28e5e-2ad0-4ee4-b2b4-f38141b369ba tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:27.467369 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e2a28e5e-2ad0-4ee4-b2b4-f38141b369ba tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:27.467843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e2a28e5e-2ad0-4ee4-b2b4-f38141b369ba tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:27.468606 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e2a28e5e-2ad0-4ee4-b2b4-f38141b369ba tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:27.469346 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e2a28e5e-2ad0-4ee4-b2b4-f38141b369ba tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:27.555123 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3f3df9d4-0bb9-42ea-8201-34afab256cf5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:27.562956 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3f3df9d4-0bb9-42ea-8201-34afab256cf5 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1569 microversion: 2.1 time: 0.183151 Jul 01 16:46:27.563722 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 379/745] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:27 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:27.629558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e2a28e5e-2ad0-4ee4-b2b4-f38141b369ba tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:27.639942 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e2a28e5e-2ad0-4ee4-b2b4-f38141b369ba tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:27.641462 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e2a28e5e-2ad0-4ee4-b2b4-f38141b369ba tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:27.642640 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e2a28e5e-2ad0-4ee4-b2b4-f38141b369ba tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1739 microversion: 2.20 time: 0.188351 Jul 01 16:46:27.643200 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 367/746] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:27 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:46:28.580507 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8fef4538-95e2-4aae-8b3d-b000ca0fe17a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:28.581124 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8fef4538-95e2-4aae-8b3d-b000ca0fe17a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:28.588607 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8fef4538-95e2-4aae-8b3d-b000ca0fe17a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:28.589060 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8fef4538-95e2-4aae-8b3d-b000ca0fe17a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:28.589830 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8fef4538-95e2-4aae-8b3d-b000ca0fe17a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:28.590269 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8fef4538-95e2-4aae-8b3d-b000ca0fe17a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:28.662387 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1bb1ec12-1cb8-4677-8afe-9f745dc5822e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:28.663440 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1bb1ec12-1cb8-4677-8afe-9f745dc5822e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:28.669957 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1bb1ec12-1cb8-4677-8afe-9f745dc5822e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:28.670436 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1bb1ec12-1cb8-4677-8afe-9f745dc5822e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:28.671233 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1bb1ec12-1cb8-4677-8afe-9f745dc5822e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:28.671665 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1bb1ec12-1cb8-4677-8afe-9f745dc5822e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:28.751760 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8fef4538-95e2-4aae-8b3d-b000ca0fe17a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:28.760248 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8fef4538-95e2-4aae-8b3d-b000ca0fe17a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1569 microversion: 2.1 time: 0.183620 Jul 01 16:46:28.760826 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 380/747] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:28 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:28.827665 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1bb1ec12-1cb8-4677-8afe-9f745dc5822e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:28.837029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1bb1ec12-1cb8-4677-8afe-9f745dc5822e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:28.839148 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1bb1ec12-1cb8-4677-8afe-9f745dc5822e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:28.840317 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1bb1ec12-1cb8-4677-8afe-9f745dc5822e tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1721 microversion: 2.20 time: 0.182579 Jul 01 16:46:28.840881 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 368/748] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:28 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:46:29.776947 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3d2d7a3a-b457-4bb6-b549-71ad004c47c9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:29.777552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3d2d7a3a-b457-4bb6-b549-71ad004c47c9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:29.784099 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3d2d7a3a-b457-4bb6-b549-71ad004c47c9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:29.784539 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3d2d7a3a-b457-4bb6-b549-71ad004c47c9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:29.785291 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3d2d7a3a-b457-4bb6-b549-71ad004c47c9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:29.785722 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3d2d7a3a-b457-4bb6-b549-71ad004c47c9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:29.859759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ab0a966c-fdd7-435c-b1c2-9324ae86e521 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:29.860293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ab0a966c-fdd7-435c-b1c2-9324ae86e521 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:29.866855 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ab0a966c-fdd7-435c-b1c2-9324ae86e521 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:29.867305 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ab0a966c-fdd7-435c-b1c2-9324ae86e521 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:29.868246 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ab0a966c-fdd7-435c-b1c2-9324ae86e521 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:29.868687 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ab0a966c-fdd7-435c-b1c2-9324ae86e521 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:29.954289 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3d2d7a3a-b457-4bb6-b549-71ad004c47c9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:29.956623 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=100 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:46:29.964243 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3d2d7a3a-b457-4bb6-b549-71ad004c47c9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1569 microversion: 2.1 time: 0.191023 Jul 01 16:46:29.964830 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 381/749] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:29 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:30.023269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ab0a966c-fdd7-435c-b1c2-9324ae86e521 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:30.031226 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ab0a966c-fdd7-435c-b1c2-9324ae86e521 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:30.032704 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ab0a966c-fdd7-435c-b1c2-9324ae86e521 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:30.033837 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ab0a966c-fdd7-435c-b1c2-9324ae86e521 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1721 microversion: 2.20 time: 0.178091 Jul 01 16:46:30.034414 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 369/750] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:29 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:46:30.982200 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0d426763-3884-4a7d-80f7-af387fdb0fe6 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:30.982856 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0d426763-3884-4a7d-80f7-af387fdb0fe6 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:30.990699 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0d426763-3884-4a7d-80f7-af387fdb0fe6 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:30.991154 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0d426763-3884-4a7d-80f7-af387fdb0fe6 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:30.991928 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0d426763-3884-4a7d-80f7-af387fdb0fe6 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:30.992365 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0d426763-3884-4a7d-80f7-af387fdb0fe6 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:31.053869 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-20786eab-ba80-4e3e-9d2a-7ffd5e78412d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:31.054633 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-20786eab-ba80-4e3e-9d2a-7ffd5e78412d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:31.061452 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-20786eab-ba80-4e3e-9d2a-7ffd5e78412d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:31.061828 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-20786eab-ba80-4e3e-9d2a-7ffd5e78412d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:31.062643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-20786eab-ba80-4e3e-9d2a-7ffd5e78412d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:31.063092 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-20786eab-ba80-4e3e-9d2a-7ffd5e78412d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:31.174727 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0d426763-3884-4a7d-80f7-af387fdb0fe6 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:31.183316 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0d426763-3884-4a7d-80f7-af387fdb0fe6 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1569 microversion: 2.1 time: 0.204995 Jul 01 16:46:31.183983 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 382/751] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:30 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:31.223900 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-20786eab-ba80-4e3e-9d2a-7ffd5e78412d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:31.231708 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-20786eab-ba80-4e3e-9d2a-7ffd5e78412d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:31.233178 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-20786eab-ba80-4e3e-9d2a-7ffd5e78412d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:31.234323 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-20786eab-ba80-4e3e-9d2a-7ffd5e78412d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1664 microversion: 2.20 time: 0.185467 Jul 01 16:46:31.234890 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 370/752] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:31 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1664 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:46:31.252417 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a2aa0007-8ab8-4d71-939b-201397f64d40 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8abc3cad-2caf-4aa8-aac5-1fac91850c7b"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:46:31.253531 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a2aa0007-8ab8-4d71-939b-201397f64d40 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:31.259629 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a2aa0007-8ab8-4d71-939b-201397f64d40 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:31.260082 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a2aa0007-8ab8-4d71-939b-201397f64d40 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:31.260854 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a2aa0007-8ab8-4d71-939b-201397f64d40 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:31.261297 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a2aa0007-8ab8-4d71-939b-201397f64d40 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:31.560698 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a2aa0007-8ab8-4d71-939b-201397f64d40 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "POST /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.312130 Jul 01 16:46:31.561469 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 383/753] 10.222.0.57 () {62 vars in 1363 bytes} [Fri Jul 1 16:46:31 2022] POST /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad/os-volume_attachments => generated 188 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 16:46:31.696953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-bbf11e62-2e5e-422a-971e-6b317812f59a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:31.697606 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-bbf11e62-2e5e-422a-971e-6b317812f59a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:31.704027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bbf11e62-2e5e-422a-971e-6b317812f59a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:31.704480 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bbf11e62-2e5e-422a-971e-6b317812f59a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:31.705255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bbf11e62-2e5e-422a-971e-6b317812f59a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:31.705702 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bbf11e62-2e5e-422a-971e-6b317812f59a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:32.004352 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-bbf11e62-2e5e-422a-971e-6b317812f59a tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad/os-volume_attachments/8abc3cad-2caf-4aa8-aac5-1fac91850c7b" status: 202 len: 0 microversion: 2.20 time: 0.312720 Jul 01 16:46:32.005723 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 371/754] 10.222.0.57 () {60 vars in 1456 bytes} [Fri Jul 1 16:46:31 2022] DELETE /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad/os-volume_attachments/8abc3cad-2caf-4aa8-aac5-1fac91850c7b => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 01 16:46:32.033042 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-fa4d4a61-72ed-4b68-ad0d-f2e969ecc313 req-66b0a843-1549-48a8-9fb5-cd1d097f99e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d5cf19-9bb2-4534-8076-564fb7538cad", "name": "network-vif-unplugged", "status": "completed", "tag": "ca06c719-80eb-4c4d-b8cd-b06d9b34ab88"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:46:32.047169 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-fa4d4a61-72ed-4b68-ad0d-f2e969ecc313 req-66b0a843-1549-48a8-9fb5-cd1d097f99e5 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:32.047612 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-fa4d4a61-72ed-4b68-ad0d-f2e969ecc313 req-66b0a843-1549-48a8-9fb5-cd1d097f99e5 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:32.066713 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.compute.server_external_events [req-fa4d4a61-72ed-4b68-ad0d-f2e969ecc313 req-66b0a843-1549-48a8-9fb5-cd1d097f99e5 service nova] Unable to find a host for instance d8d5cf19-9bb2-4534-8076-564fb7538cad. Dropping event network-vif-unplugged {{(pid=124316) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 01 16:46:32.068365 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-fa4d4a61-72ed-4b68-ad0d-f2e969ecc313 req-66b0a843-1549-48a8-9fb5-cd1d097f99e5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040109 Jul 01 16:46:32.068962 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 384/755] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 01 16:46:32.069827 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b9a220a2-38d0-443a-874a-1a7e8383e569 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:46:32.070416 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b9a220a2-38d0-443a-874a-1a7e8383e569 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:32.078001 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b9a220a2-38d0-443a-874a-1a7e8383e569 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:32.078479 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b9a220a2-38d0-443a-874a-1a7e8383e569 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:32.079267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b9a220a2-38d0-443a-874a-1a7e8383e569 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:32.080740 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b9a220a2-38d0-443a-874a-1a7e8383e569 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:32.200912 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8f46a599-fb3e-46b8-a130-c0792cf1007e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:32.201636 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8f46a599-fb3e-46b8-a130-c0792cf1007e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:32.208882 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8f46a599-fb3e-46b8-a130-c0792cf1007e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:32.209337 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8f46a599-fb3e-46b8-a130-c0792cf1007e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:32.210225 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8f46a599-fb3e-46b8-a130-c0792cf1007e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:32.210640 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8f46a599-fb3e-46b8-a130-c0792cf1007e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:32.269121 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b9a220a2-38d0-443a-874a-1a7e8383e569 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "POST /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad/action" status: 202 len: 0 microversion: 2.20 time: 0.203472 Jul 01 16:46:32.270651 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 372/756] 10.222.0.57 () {62 vars in 1318 bytes} [Fri Jul 1 16:46:32 2022] POST /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 16:46:32.278510 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-bbbf6240-8aad-43ed-8fbd-1b4359b124e8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:32.279388 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-bbbf6240-8aad-43ed-8fbd-1b4359b124e8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:32.287511 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bbbf6240-8aad-43ed-8fbd-1b4359b124e8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:32.288042 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bbbf6240-8aad-43ed-8fbd-1b4359b124e8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:32.288881 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bbbf6240-8aad-43ed-8fbd-1b4359b124e8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:32.289382 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bbbf6240-8aad-43ed-8fbd-1b4359b124e8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:32.390960 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8f46a599-fb3e-46b8-a130-c0792cf1007e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:32.399566 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8f46a599-fb3e-46b8-a130-c0792cf1007e tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1569 microversion: 2.1 time: 0.201860 Jul 01 16:46:32.409312 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 385/757] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:32 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:46:32.460288 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bbbf6240-8aad-43ed-8fbd-1b4359b124e8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:32.468225 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bbbf6240-8aad-43ed-8fbd-1b4359b124e8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:32.469729 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bbbf6240-8aad-43ed-8fbd-1b4359b124e8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:32.470906 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-bbbf6240-8aad-43ed-8fbd-1b4359b124e8 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1672 microversion: 2.20 time: 0.196242 Jul 01 16:46:32.471463 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 373/758] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:32 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1672 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:33.416358 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-44d504a5-f7a5-42d8-848d-891349f7096a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:33.416955 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-44d504a5-f7a5-42d8-848d-891349f7096a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:33.423933 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-44d504a5-f7a5-42d8-848d-891349f7096a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:33.424401 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-44d504a5-f7a5-42d8-848d-891349f7096a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:33.425200 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-44d504a5-f7a5-42d8-848d-891349f7096a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:33.425633 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-44d504a5-f7a5-42d8-848d-891349f7096a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:33.491744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-80e19a4c-1363-4100-9c0c-3fb78a0386fd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:33.493043 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-80e19a4c-1363-4100-9c0c-3fb78a0386fd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:33.506087 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-80e19a4c-1363-4100-9c0c-3fb78a0386fd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:33.506586 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-80e19a4c-1363-4100-9c0c-3fb78a0386fd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:33.507898 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-80e19a4c-1363-4100-9c0c-3fb78a0386fd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:33.508516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-80e19a4c-1363-4100-9c0c-3fb78a0386fd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:33.638791 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-44d504a5-f7a5-42d8-848d-891349f7096a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:33.647854 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-44d504a5-f7a5-42d8-848d-891349f7096a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1569 microversion: 2.1 time: 0.235284 Jul 01 16:46:33.657816 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 386/759] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:33 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:33.693760 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-80e19a4c-1363-4100-9c0c-3fb78a0386fd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:33.697226 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:46:33.702704 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-80e19a4c-1363-4100-9c0c-3fb78a0386fd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:33.704168 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-80e19a4c-1363-4100-9c0c-3fb78a0386fd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:33.705310 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-80e19a4c-1363-4100-9c0c-3fb78a0386fd tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1730 microversion: 2.20 time: 0.218982 Jul 01 16:46:33.705865 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 374/760] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:33 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1730 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:46:34.665386 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1ecc5f89-a211-4bdb-b06b-a230d9f730ec tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:34.666146 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1ecc5f89-a211-4bdb-b06b-a230d9f730ec tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:34.673384 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1ecc5f89-a211-4bdb-b06b-a230d9f730ec tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:34.675562 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1ecc5f89-a211-4bdb-b06b-a230d9f730ec tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:34.676367 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1ecc5f89-a211-4bdb-b06b-a230d9f730ec tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:34.677360 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1ecc5f89-a211-4bdb-b06b-a230d9f730ec tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:34.725065 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-128afbcd-e1a5-4106-ba66-0e6ab9c76ba4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:34.725848 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-128afbcd-e1a5-4106-ba66-0e6ab9c76ba4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:34.734845 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-128afbcd-e1a5-4106-ba66-0e6ab9c76ba4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:34.735293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-128afbcd-e1a5-4106-ba66-0e6ab9c76ba4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:34.736100 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-128afbcd-e1a5-4106-ba66-0e6ab9c76ba4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:34.736837 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-128afbcd-e1a5-4106-ba66-0e6ab9c76ba4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:35.070131 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-1ecc5f89-a211-4bdb-b06b-a230d9f730ec tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:35.085451 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1ecc5f89-a211-4bdb-b06b-a230d9f730ec tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1510 microversion: 2.1 time: 0.424721 Jul 01 16:46:35.090990 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 387/761] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:34 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1510 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:35.096978 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-77cef74b-4919-4b58-9b5f-eb3c25aea7e2 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:35.097789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-77cef74b-4919-4b58-9b5f-eb3c25aea7e2 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:35.124284 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-77cef74b-4919-4b58-9b5f-eb3c25aea7e2 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:35.125282 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-77cef74b-4919-4b58-9b5f-eb3c25aea7e2 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:35.127166 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-77cef74b-4919-4b58-9b5f-eb3c25aea7e2 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:35.129491 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-77cef74b-4919-4b58-9b5f-eb3c25aea7e2 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:35.144847 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-128afbcd-e1a5-4106-ba66-0e6ab9c76ba4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:35.158886 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-128afbcd-e1a5-4106-ba66-0e6ab9c76ba4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:35.162294 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-128afbcd-e1a5-4106-ba66-0e6ab9c76ba4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:35.163937 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-128afbcd-e1a5-4106-ba66-0e6ab9c76ba4 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1730 microversion: 2.20 time: 0.443586 Jul 01 16:46:35.165815 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 375/762] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:34 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1730 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:46:35.171662 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-502e17b2-59cc-4145-98b6-44cb5b6cc3f3 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:46:35.172671 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-502e17b2-59cc-4145-98b6-44cb5b6cc3f3 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:35.179123 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-502e17b2-59cc-4145-98b6-44cb5b6cc3f3 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:35.179837 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-502e17b2-59cc-4145-98b6-44cb5b6cc3f3 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:35.181510 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-502e17b2-59cc-4145-98b6-44cb5b6cc3f3 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:35.182262 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-502e17b2-59cc-4145-98b6-44cb5b6cc3f3 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:35.212715 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-77cef74b-4919-4b58-9b5f-eb3c25aea7e2 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b/ips" status: 200 len: 151 microversion: 2.1 time: 0.120546 Jul 01 16:46:35.215816 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 388/763] 10.222.0.57 () {58 vars in 1247 bytes} [Fri Jul 1 16:46:35 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b/ips => generated 151 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:46:35.336019 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-502e17b2-59cc-4145-98b6-44cb5b6cc3f3 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "POST /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef/action" status: 202 len: 0 microversion: 2.1 time: 0.168762 Jul 01 16:46:35.336571 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 376/764] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 1 16:46:35 2022] POST /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:46:35.346042 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c9598357-5dc4-40d9-975f-4b1f1ecbcead tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:35.346945 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c9598357-5dc4-40d9-975f-4b1f1ecbcead tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:35.363249 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c9598357-5dc4-40d9-975f-4b1f1ecbcead tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:35.367063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c9598357-5dc4-40d9-975f-4b1f1ecbcead tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:35.369516 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c9598357-5dc4-40d9-975f-4b1f1ecbcead tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:35.371592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c9598357-5dc4-40d9-975f-4b1f1ecbcead tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:35.611832 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c9598357-5dc4-40d9-975f-4b1f1ecbcead tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:35.639786 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c9598357-5dc4-40d9-975f-4b1f1ecbcead tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1518 microversion: 2.1 time: 0.298390 Jul 01 16:46:35.642164 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 389/765] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:35 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1518 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:36.055812 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-a49b9d05-9119-4f5f-beda-78b8b98ac8dc req-e8a14571-eac4-49d2-81d5-6dcf1e80d76f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "602a9841-5b03-4f60-b3be-7c4efe7cd9ef", "name": "network-vif-unplugged", "status": "completed", "tag": "dfaabde7-2cdd-46ea-9860-694b36767f5e"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:46:36.087738 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-a49b9d05-9119-4f5f-beda-78b8b98ac8dc req-e8a14571-eac4-49d2-81d5-6dcf1e80d76f service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:36.088289 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-a49b9d05-9119-4f5f-beda-78b8b98ac8dc req-e8a14571-eac4-49d2-81d5-6dcf1e80d76f service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:36.129621 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.compute.server_external_events [req-a49b9d05-9119-4f5f-beda-78b8b98ac8dc req-e8a14571-eac4-49d2-81d5-6dcf1e80d76f service nova] Unable to find a host for instance 602a9841-5b03-4f60-b3be-7c4efe7cd9ef. Dropping event network-vif-unplugged {{(pid=124317) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 01 16:46:36.134335 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-a49b9d05-9119-4f5f-beda-78b8b98ac8dc req-e8a14571-eac4-49d2-81d5-6dcf1e80d76f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.082257 Jul 01 16:46:36.135693 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 377/766] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 85 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 01 16:46:36.183148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-87168c40-4911-4974-91db-51331293e4b1 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:36.184491 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-87168c40-4911-4974-91db-51331293e4b1 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:36.194577 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-87168c40-4911-4974-91db-51331293e4b1 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:36.195313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-87168c40-4911-4974-91db-51331293e4b1 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:36.197092 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-87168c40-4911-4974-91db-51331293e4b1 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:36.197600 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-87168c40-4911-4974-91db-51331293e4b1 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:36.432374 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-87168c40-4911-4974-91db-51331293e4b1 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:36.454380 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-87168c40-4911-4974-91db-51331293e4b1 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:36.455878 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-87168c40-4911-4974-91db-51331293e4b1 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:36.457049 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-87168c40-4911-4974-91db-51331293e4b1 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1730 microversion: 2.20 time: 0.278128 Jul 01 16:46:36.479634 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 390/767] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:36 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1730 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:36.663204 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3ae44a45-8998-4abf-985f-1c1e768788c2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:36.664118 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3ae44a45-8998-4abf-985f-1c1e768788c2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:36.671261 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3ae44a45-8998-4abf-985f-1c1e768788c2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:36.672136 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3ae44a45-8998-4abf-985f-1c1e768788c2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:36.673192 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3ae44a45-8998-4abf-985f-1c1e768788c2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:36.673843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3ae44a45-8998-4abf-985f-1c1e768788c2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:36.889973 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3ae44a45-8998-4abf-985f-1c1e768788c2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:36.898931 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3ae44a45-8998-4abf-985f-1c1e768788c2 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1518 microversion: 2.1 time: 0.241885 Jul 01 16:46:36.910230 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 378/768] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:36 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1518 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:36.940952 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-55c85e8d-23d1-4c36-b243-f4893a64bc0c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a947ca5d-2fcf-49a2-89cc-20c58b0c94d4"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:46:36.943165 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-55c85e8d-23d1-4c36-b243-f4893a64bc0c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:36.949604 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-55c85e8d-23d1-4c36-b243-f4893a64bc0c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:36.950146 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-55c85e8d-23d1-4c36-b243-f4893a64bc0c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:36.951211 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-55c85e8d-23d1-4c36-b243-f4893a64bc0c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:36.951714 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-55c85e8d-23d1-4c36-b243-f4893a64bc0c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:37.477515 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3d554ebc-8ff5-4dcb-8fbf-96fbe68844af tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:37.478921 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3d554ebc-8ff5-4dcb-8fbf-96fbe68844af tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:37.485662 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3d554ebc-8ff5-4dcb-8fbf-96fbe68844af tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:37.486109 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3d554ebc-8ff5-4dcb-8fbf-96fbe68844af tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:37.486904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3d554ebc-8ff5-4dcb-8fbf-96fbe68844af tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:37.487341 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3d554ebc-8ff5-4dcb-8fbf-96fbe68844af tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:37.756610 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3d554ebc-8ff5-4dcb-8fbf-96fbe68844af tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:37.766308 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3d554ebc-8ff5-4dcb-8fbf-96fbe68844af tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:37.768889 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3d554ebc-8ff5-4dcb-8fbf-96fbe68844af tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:37.770861 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3d554ebc-8ff5-4dcb-8fbf-96fbe68844af tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1730 microversion: 2.20 time: 0.298084 Jul 01 16:46:37.771902 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 379/769] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:37 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1730 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:46:37.921536 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9887800b-3323-41b3-9440-4822f2b392a8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:37.925291 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-9887800b-3323-41b3-9440-4822f2b392a8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:37.935837 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9887800b-3323-41b3-9440-4822f2b392a8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:37.936888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9887800b-3323-41b3-9440-4822f2b392a8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:37.938698 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9887800b-3323-41b3-9440-4822f2b392a8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:37.939435 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9887800b-3323-41b3-9440-4822f2b392a8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:38.117449 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9887800b-3323-41b3-9440-4822f2b392a8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:38.125257 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9887800b-3323-41b3-9440-4822f2b392a8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1518 microversion: 2.1 time: 0.211021 Jul 01 16:46:38.135998 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 380/770] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:37 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1518 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:38.790804 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f2cf5490-0d84-4ae9-a40e-945b714fe783 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:38.792606 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f2cf5490-0d84-4ae9-a40e-945b714fe783 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:38.802089 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f2cf5490-0d84-4ae9-a40e-945b714fe783 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:38.803102 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f2cf5490-0d84-4ae9-a40e-945b714fe783 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:38.804541 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f2cf5490-0d84-4ae9-a40e-945b714fe783 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:38.805323 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f2cf5490-0d84-4ae9-a40e-945b714fe783 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:38.974580 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f2cf5490-0d84-4ae9-a40e-945b714fe783 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:38.985679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f2cf5490-0d84-4ae9-a40e-945b714fe783 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:38.987424 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f2cf5490-0d84-4ae9-a40e-945b714fe783 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:38.994936 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f2cf5490-0d84-4ae9-a40e-945b714fe783 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1730 microversion: 2.20 time: 0.203345 Jul 01 16:46:38.996239 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 381/771] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:38 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1730 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:46:39.142616 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5a8cd659-b10a-4018-ba54-8e27d9c160d9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:39.143223 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5a8cd659-b10a-4018-ba54-8e27d9c160d9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:39.145628 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=58 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:46:39.151513 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5a8cd659-b10a-4018-ba54-8e27d9c160d9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:39.151966 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5a8cd659-b10a-4018-ba54-8e27d9c160d9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:39.152741 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5a8cd659-b10a-4018-ba54-8e27d9c160d9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:39.153172 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5a8cd659-b10a-4018-ba54-8e27d9c160d9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:39.337288 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5a8cd659-b10a-4018-ba54-8e27d9c160d9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:39.345865 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5a8cd659-b10a-4018-ba54-8e27d9c160d9 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1518 microversion: 2.1 time: 0.206911 Jul 01 16:46:39.357593 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 382/772] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:39 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1518 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:40.014041 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ec2b3d67-d55a-46f1-be3e-90c74c752777 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:40.014710 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ec2b3d67-d55a-46f1-be3e-90c74c752777 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:40.023606 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ec2b3d67-d55a-46f1-be3e-90c74c752777 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:40.024149 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ec2b3d67-d55a-46f1-be3e-90c74c752777 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:40.025020 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ec2b3d67-d55a-46f1-be3e-90c74c752777 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:40.025525 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ec2b3d67-d55a-46f1-be3e-90c74c752777 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:40.216378 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ec2b3d67-d55a-46f1-be3e-90c74c752777 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:40.231244 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ec2b3d67-d55a-46f1-be3e-90c74c752777 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:40.232747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ec2b3d67-d55a-46f1-be3e-90c74c752777 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:40.234122 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ec2b3d67-d55a-46f1-be3e-90c74c752777 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1730 microversion: 2.20 time: 0.224904 Jul 01 16:46:40.245274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 383/773] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:40 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1730 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:46:40.365614 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-796147af-1b4f-4187-aa18-a906359bcff4 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:40.366540 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-796147af-1b4f-4187-aa18-a906359bcff4 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:40.373638 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-796147af-1b4f-4187-aa18-a906359bcff4 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:40.383096 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-796147af-1b4f-4187-aa18-a906359bcff4 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:40.383997 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-796147af-1b4f-4187-aa18-a906359bcff4 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:40.384439 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-796147af-1b4f-4187-aa18-a906359bcff4 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:40.581067 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-796147af-1b4f-4187-aa18-a906359bcff4 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:40.593194 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-796147af-1b4f-4187-aa18-a906359bcff4 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1518 microversion: 2.1 time: 0.232520 Jul 01 16:46:40.593794 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 384/774] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:40 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1518 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:46:41.253110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-bb9fd5ad-ac8a-4224-92c5-88b472711849 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:41.253726 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-bb9fd5ad-ac8a-4224-92c5-88b472711849 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:41.261580 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bb9fd5ad-ac8a-4224-92c5-88b472711849 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:41.262588 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bb9fd5ad-ac8a-4224-92c5-88b472711849 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:41.263774 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bb9fd5ad-ac8a-4224-92c5-88b472711849 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:41.264521 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bb9fd5ad-ac8a-4224-92c5-88b472711849 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:41.417564 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bb9fd5ad-ac8a-4224-92c5-88b472711849 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:41.427103 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bb9fd5ad-ac8a-4224-92c5-88b472711849 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:41.428864 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bb9fd5ad-ac8a-4224-92c5-88b472711849 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:41.430236 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-bb9fd5ad-ac8a-4224-92c5-88b472711849 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1730 microversion: 2.20 time: 0.181224 Jul 01 16:46:41.433284 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 385/775] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:41 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:46:41.611934 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-89d12fb3-b0c8-4f21-b4b2-301981af0c17 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:41.612579 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-89d12fb3-b0c8-4f21-b4b2-301981af0c17 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:41.620308 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-89d12fb3-b0c8-4f21-b4b2-301981af0c17 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:41.620759 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-89d12fb3-b0c8-4f21-b4b2-301981af0c17 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:41.621530 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-89d12fb3-b0c8-4f21-b4b2-301981af0c17 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:41.622107 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-89d12fb3-b0c8-4f21-b4b2-301981af0c17 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:41.792987 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-89d12fb3-b0c8-4f21-b4b2-301981af0c17 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:41.802855 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-89d12fb3-b0c8-4f21-b4b2-301981af0c17 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1518 microversion: 2.1 time: 0.194696 Jul 01 16:46:41.803578 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 386/776] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:41 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1518 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:46:42.449107 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b2a4cf42-a77d-4cd5-b074-29f181b8f49b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:42.449834 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b2a4cf42-a77d-4cd5-b074-29f181b8f49b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:42.456903 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b2a4cf42-a77d-4cd5-b074-29f181b8f49b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:42.458692 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b2a4cf42-a77d-4cd5-b074-29f181b8f49b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:42.459705 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b2a4cf42-a77d-4cd5-b074-29f181b8f49b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:42.460215 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b2a4cf42-a77d-4cd5-b074-29f181b8f49b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:42.610025 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b2a4cf42-a77d-4cd5-b074-29f181b8f49b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:42.625913 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b2a4cf42-a77d-4cd5-b074-29f181b8f49b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:42.627439 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b2a4cf42-a77d-4cd5-b074-29f181b8f49b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:42.628602 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b2a4cf42-a77d-4cd5-b074-29f181b8f49b tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1730 microversion: 2.20 time: 0.183384 Jul 01 16:46:42.629266 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 387/777] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:42 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:46:42.820962 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3f59501e-545e-4c87-bca2-de6019d41208 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:42.821892 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3f59501e-545e-4c87-bca2-de6019d41208 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:42.830106 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3f59501e-545e-4c87-bca2-de6019d41208 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:42.830601 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3f59501e-545e-4c87-bca2-de6019d41208 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:42.831531 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3f59501e-545e-4c87-bca2-de6019d41208 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:42.832630 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3f59501e-545e-4c87-bca2-de6019d41208 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:42.983524 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3f59501e-545e-4c87-bca2-de6019d41208 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:42.991253 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3f59501e-545e-4c87-bca2-de6019d41208 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1518 microversion: 2.1 time: 0.175163 Jul 01 16:46:42.991830 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 388/778] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:42 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:46:43.647439 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-47bed0aa-d91f-4a29-ab9c-8711011b9a50 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:43.648122 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-47bed0aa-d91f-4a29-ab9c-8711011b9a50 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:43.654549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-47bed0aa-d91f-4a29-ab9c-8711011b9a50 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:43.655021 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-47bed0aa-d91f-4a29-ab9c-8711011b9a50 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:43.655766 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-47bed0aa-d91f-4a29-ab9c-8711011b9a50 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:43.656194 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-47bed0aa-d91f-4a29-ab9c-8711011b9a50 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:43.792326 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-47bed0aa-d91f-4a29-ab9c-8711011b9a50 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:43.800316 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-47bed0aa-d91f-4a29-ab9c-8711011b9a50 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:43.801927 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-47bed0aa-d91f-4a29-ab9c-8711011b9a50 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:43.803115 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-47bed0aa-d91f-4a29-ab9c-8711011b9a50 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1730 microversion: 2.20 time: 0.159778 Jul 01 16:46:43.803676 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 389/779] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:43 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:46:44.009504 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c58d59b5-2208-4273-b85c-8dfa4ac59c3b tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:44.010033 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c58d59b5-2208-4273-b85c-8dfa4ac59c3b tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:44.016327 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c58d59b5-2208-4273-b85c-8dfa4ac59c3b tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:44.016775 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c58d59b5-2208-4273-b85c-8dfa4ac59c3b tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:44.017532 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c58d59b5-2208-4273-b85c-8dfa4ac59c3b tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:44.018001 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c58d59b5-2208-4273-b85c-8dfa4ac59c3b tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:44.152012 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c58d59b5-2208-4273-b85c-8dfa4ac59c3b tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:44.159580 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c58d59b5-2208-4273-b85c-8dfa4ac59c3b tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1518 microversion: 2.1 time: 0.154116 Jul 01 16:46:44.160198 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 390/780] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:44 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:46:44.821279 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-98589dbe-8939-46b6-b517-b1433d886cef tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:44.821920 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-98589dbe-8939-46b6-b517-b1433d886cef tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:44.828336 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98589dbe-8939-46b6-b517-b1433d886cef tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:44.828786 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98589dbe-8939-46b6-b517-b1433d886cef tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:44.829579 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98589dbe-8939-46b6-b517-b1433d886cef tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:44.830036 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98589dbe-8939-46b6-b517-b1433d886cef tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:44.834880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:46:44.968498 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-98589dbe-8939-46b6-b517-b1433d886cef tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:44.977451 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-98589dbe-8939-46b6-b517-b1433d886cef tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:44.978986 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-98589dbe-8939-46b6-b517-b1433d886cef tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:44.980131 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-98589dbe-8939-46b6-b517-b1433d886cef tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1730 microversion: 2.20 time: 0.162999 Jul 01 16:46:44.980682 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 391/781] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:44 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:46:45.176697 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-39600527-fcc9-48b3-9129-949b1cc035cc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:45.177207 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-39600527-fcc9-48b3-9129-949b1cc035cc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:45.183179 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-39600527-fcc9-48b3-9129-949b1cc035cc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:45.183643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-39600527-fcc9-48b3-9129-949b1cc035cc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:45.184385 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-39600527-fcc9-48b3-9129-949b1cc035cc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:45.184806 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-39600527-fcc9-48b3-9129-949b1cc035cc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:45.318957 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-39600527-fcc9-48b3-9129-949b1cc035cc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:45.326378 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-39600527-fcc9-48b3-9129-949b1cc035cc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1518 microversion: 2.1 time: 0.153662 Jul 01 16:46:45.326936 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 392/782] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:45 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:46:45.650873 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-55c85e8d-23d1-4c36-b243-f4893a64bc0c tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "POST /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.713453 Jul 01 16:46:45.651675 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 391/783] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 1 16:46:36 2022] POST /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b/os-volume_attachments => generated 194 bytes in 8715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:46:45.998582 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-96b95358-a5f3-4e40-ae23-b9c0e2e5e9f9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:45.999188 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-96b95358-a5f3-4e40-ae23-b9c0e2e5e9f9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:46.006745 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-96b95358-a5f3-4e40-ae23-b9c0e2e5e9f9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:46.007191 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-96b95358-a5f3-4e40-ae23-b9c0e2e5e9f9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:46.007954 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-96b95358-a5f3-4e40-ae23-b9c0e2e5e9f9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:46.008384 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-96b95358-a5f3-4e40-ae23-b9c0e2e5e9f9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:46.143206 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-96b95358-a5f3-4e40-ae23-b9c0e2e5e9f9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:46.151782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-96b95358-a5f3-4e40-ae23-b9c0e2e5e9f9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:46.153254 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-96b95358-a5f3-4e40-ae23-b9c0e2e5e9f9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:46.154417 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-96b95358-a5f3-4e40-ae23-b9c0e2e5e9f9 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1730 microversion: 2.20 time: 0.159745 Jul 01 16:46:46.154972 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 393/784] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:45 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:46.344216 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-09a32eef-0e39-424d-87e5-2e3e96f05119 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:46.344907 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-09a32eef-0e39-424d-87e5-2e3e96f05119 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:46.347355 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=48 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:46:46.355056 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-09a32eef-0e39-424d-87e5-2e3e96f05119 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:46.355497 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-09a32eef-0e39-424d-87e5-2e3e96f05119 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:46.356268 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-09a32eef-0e39-424d-87e5-2e3e96f05119 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:46.356891 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-09a32eef-0e39-424d-87e5-2e3e96f05119 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:46.503415 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-09a32eef-0e39-424d-87e5-2e3e96f05119 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:46.514487 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-09a32eef-0e39-424d-87e5-2e3e96f05119 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1520 microversion: 2.1 time: 0.174096 Jul 01 16:46:46.515245 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 392/785] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:46 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:46:47.172448 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3e947d2c-ac27-4caf-bb9e-b3ca668bb052 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:47.173120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3e947d2c-ac27-4caf-bb9e-b3ca668bb052 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:47.180539 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3e947d2c-ac27-4caf-bb9e-b3ca668bb052 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:47.180986 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3e947d2c-ac27-4caf-bb9e-b3ca668bb052 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:47.181803 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3e947d2c-ac27-4caf-bb9e-b3ca668bb052 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:47.182238 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3e947d2c-ac27-4caf-bb9e-b3ca668bb052 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:47.333422 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3e947d2c-ac27-4caf-bb9e-b3ca668bb052 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:47.343876 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3e947d2c-ac27-4caf-bb9e-b3ca668bb052 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:47.345486 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3e947d2c-ac27-4caf-bb9e-b3ca668bb052 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:47.346872 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3e947d2c-ac27-4caf-bb9e-b3ca668bb052 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1730 microversion: 2.20 time: 0.178153 Jul 01 16:46:47.347447 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 394/786] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:47 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:47.532493 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-66e96007-b1b2-4400-b28b-1d856d10ba9d tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:47.533102 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-66e96007-b1b2-4400-b28b-1d856d10ba9d tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:47.539641 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-66e96007-b1b2-4400-b28b-1d856d10ba9d tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:47.540091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-66e96007-b1b2-4400-b28b-1d856d10ba9d tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:47.540849 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-66e96007-b1b2-4400-b28b-1d856d10ba9d tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:47.541281 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-66e96007-b1b2-4400-b28b-1d856d10ba9d tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:47.680835 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-66e96007-b1b2-4400-b28b-1d856d10ba9d tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:47.688330 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-66e96007-b1b2-4400-b28b-1d856d10ba9d tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1576 microversion: 2.1 time: 0.159816 Jul 01 16:46:47.688891 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 393/787] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:47 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:48.367560 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e77d3ce7-5491-44db-881f-e70551dd4c04 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:48.368246 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e77d3ce7-5491-44db-881f-e70551dd4c04 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:48.374699 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e77d3ce7-5491-44db-881f-e70551dd4c04 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:48.375405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e77d3ce7-5491-44db-881f-e70551dd4c04 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:48.376199 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e77d3ce7-5491-44db-881f-e70551dd4c04 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:48.376638 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e77d3ce7-5491-44db-881f-e70551dd4c04 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:48.522233 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e77d3ce7-5491-44db-881f-e70551dd4c04 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:48.530960 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e77d3ce7-5491-44db-881f-e70551dd4c04 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:48.532457 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e77d3ce7-5491-44db-881f-e70551dd4c04 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:48.533859 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e77d3ce7-5491-44db-881f-e70551dd4c04 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1730 microversion: 2.20 time: 0.171034 Jul 01 16:46:48.534640 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 395/788] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:48 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:48.706180 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cd5edd2d-5e2a-49c3-9a3e-bbfce945166f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:48.707376 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-cd5edd2d-5e2a-49c3-9a3e-bbfce945166f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:48.714191 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cd5edd2d-5e2a-49c3-9a3e-bbfce945166f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:48.714686 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cd5edd2d-5e2a-49c3-9a3e-bbfce945166f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:48.715428 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cd5edd2d-5e2a-49c3-9a3e-bbfce945166f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:48.715861 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cd5edd2d-5e2a-49c3-9a3e-bbfce945166f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:48.852569 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-cd5edd2d-5e2a-49c3-9a3e-bbfce945166f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:48.860056 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-cd5edd2d-5e2a-49c3-9a3e-bbfce945166f tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1576 microversion: 2.1 time: 0.157990 Jul 01 16:46:48.860630 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 394/789] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:48 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:46:49.554611 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4ae42b04-8025-4082-9b1b-c2914d4d7016 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:49.555287 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4ae42b04-8025-4082-9b1b-c2914d4d7016 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:49.563099 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4ae42b04-8025-4082-9b1b-c2914d4d7016 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:49.563548 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4ae42b04-8025-4082-9b1b-c2914d4d7016 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:49.564310 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4ae42b04-8025-4082-9b1b-c2914d4d7016 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:49.564790 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4ae42b04-8025-4082-9b1b-c2914d4d7016 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:49.701231 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4ae42b04-8025-4082-9b1b-c2914d4d7016 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:49.709545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4ae42b04-8025-4082-9b1b-c2914d4d7016 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:49.711226 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4ae42b04-8025-4082-9b1b-c2914d4d7016 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:49.712751 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4ae42b04-8025-4082-9b1b-c2914d4d7016 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1730 microversion: 2.20 time: 0.163191 Jul 01 16:46:49.713428 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 396/790] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:49 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:49.878913 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0daff035-3e9b-4479-b0f9-500ef7d30527 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:49.880237 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0daff035-3e9b-4479-b0f9-500ef7d30527 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:49.890506 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0daff035-3e9b-4479-b0f9-500ef7d30527 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:49.890964 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0daff035-3e9b-4479-b0f9-500ef7d30527 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:49.892154 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0daff035-3e9b-4479-b0f9-500ef7d30527 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:49.892644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0daff035-3e9b-4479-b0f9-500ef7d30527 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:49.908417 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:46:50.065201 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0daff035-3e9b-4479-b0f9-500ef7d30527 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:50.073684 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0daff035-3e9b-4479-b0f9-500ef7d30527 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1576 microversion: 2.1 time: 0.200409 Jul 01 16:46:50.085472 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 395/791] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:49 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1576 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:50.179036 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-6096b1f4-c838-4baa-a69a-a0df78bad370 req-b129c1ff-363d-42dc-ae01-5918cbed50a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d5cf19-9bb2-4534-8076-564fb7538cad", "name": "network-vif-plugged", "status": "completed", "tag": "ca06c719-80eb-4c4d-b8cd-b06d9b34ab88"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:46:50.189541 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-6096b1f4-c838-4baa-a69a-a0df78bad370 req-b129c1ff-363d-42dc-ae01-5918cbed50a2 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:50.191968 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-6096b1f4-c838-4baa-a69a-a0df78bad370 req-b129c1ff-363d-42dc-ae01-5918cbed50a2 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:50.211678 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-6096b1f4-c838-4baa-a69a-a0df78bad370 req-b129c1ff-363d-42dc-ae01-5918cbed50a2 service nova] Creating event network-vif-plugged:ca06c719-80eb-4c4d-b8cd-b06d9b34ab88 for instance d8d5cf19-9bb2-4534-8076-564fb7538cad on hv-cinder-79760 Jul 01 16:46:50.216668 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-6096b1f4-c838-4baa-a69a-a0df78bad370 req-b129c1ff-363d-42dc-ae01-5918cbed50a2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043162 Jul 01 16:46:50.217700 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 397/792] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:46:50.734101 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3cfc0639-0f28-4537-b328-0ef123f3e929 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:50.735076 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3cfc0639-0f28-4537-b328-0ef123f3e929 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:50.744849 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3cfc0639-0f28-4537-b328-0ef123f3e929 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:50.745532 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3cfc0639-0f28-4537-b328-0ef123f3e929 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:50.746766 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3cfc0639-0f28-4537-b328-0ef123f3e929 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:50.747453 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3cfc0639-0f28-4537-b328-0ef123f3e929 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:50.895605 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3cfc0639-0f28-4537-b328-0ef123f3e929 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:50.904055 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3cfc0639-0f28-4537-b328-0ef123f3e929 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:50.905630 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3cfc0639-0f28-4537-b328-0ef123f3e929 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:50.906810 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3cfc0639-0f28-4537-b328-0ef123f3e929 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1730 microversion: 2.20 time: 0.178902 Jul 01 16:46:50.907369 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 396/793] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:50 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:51.097138 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4459afa1-2ea1-4321-85c2-5d3d8cd23fe8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:51.098985 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4459afa1-2ea1-4321-85c2-5d3d8cd23fe8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:51.105932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4459afa1-2ea1-4321-85c2-5d3d8cd23fe8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:51.106398 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4459afa1-2ea1-4321-85c2-5d3d8cd23fe8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:51.107155 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4459afa1-2ea1-4321-85c2-5d3d8cd23fe8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:51.107585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4459afa1-2ea1-4321-85c2-5d3d8cd23fe8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:51.251236 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4459afa1-2ea1-4321-85c2-5d3d8cd23fe8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:51.259335 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4459afa1-2ea1-4321-85c2-5d3d8cd23fe8 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1576 microversion: 2.1 time: 0.168549 Jul 01 16:46:51.259908 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 398/794] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:51 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:51.927440 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d696dd89-3cf6-4609-bce7-0cafcad45944 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:51.927440 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d696dd89-3cf6-4609-bce7-0cafcad45944 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:51.933937 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d696dd89-3cf6-4609-bce7-0cafcad45944 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:51.934416 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d696dd89-3cf6-4609-bce7-0cafcad45944 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:51.935219 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d696dd89-3cf6-4609-bce7-0cafcad45944 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:51.935683 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d696dd89-3cf6-4609-bce7-0cafcad45944 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:52.069958 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d696dd89-3cf6-4609-bce7-0cafcad45944 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:52.077885 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d696dd89-3cf6-4609-bce7-0cafcad45944 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:52.079460 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d696dd89-3cf6-4609-bce7-0cafcad45944 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:52.080626 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d696dd89-3cf6-4609-bce7-0cafcad45944 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1730 microversion: 2.20 time: 0.158628 Jul 01 16:46:52.081187 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 397/795] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:51 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:52.276482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-972a7627-1c21-4e45-9e9d-72dbf68a166a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:52.277263 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-972a7627-1c21-4e45-9e9d-72dbf68a166a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:52.283492 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-972a7627-1c21-4e45-9e9d-72dbf68a166a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:52.284119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-972a7627-1c21-4e45-9e9d-72dbf68a166a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:52.285815 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-972a7627-1c21-4e45-9e9d-72dbf68a166a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:52.286471 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-972a7627-1c21-4e45-9e9d-72dbf68a166a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:52.470120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-972a7627-1c21-4e45-9e9d-72dbf68a166a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:52.478896 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-972a7627-1c21-4e45-9e9d-72dbf68a166a tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1576 microversion: 2.1 time: 0.206582 Jul 01 16:46:52.479469 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 399/796] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:52 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1576 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:53.098799 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8a018d2c-a27d-46ef-ad8e-4f4beece9ad3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:53.099517 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8a018d2c-a27d-46ef-ad8e-4f4beece9ad3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:53.107008 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8a018d2c-a27d-46ef-ad8e-4f4beece9ad3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:53.107571 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8a018d2c-a27d-46ef-ad8e-4f4beece9ad3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:53.108353 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8a018d2c-a27d-46ef-ad8e-4f4beece9ad3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:53.108963 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8a018d2c-a27d-46ef-ad8e-4f4beece9ad3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:53.245020 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8a018d2c-a27d-46ef-ad8e-4f4beece9ad3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:53.253234 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8a018d2c-a27d-46ef-ad8e-4f4beece9ad3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:53.254818 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8a018d2c-a27d-46ef-ad8e-4f4beece9ad3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:53.255977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8a018d2c-a27d-46ef-ad8e-4f4beece9ad3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1717 microversion: 2.20 time: 0.161479 Jul 01 16:46:53.256533 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 398/797] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:46:53 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1717 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:46:53.496123 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-28a0eafa-f9f4-4afe-aa52-7d281ae9a647 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:53.496697 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-28a0eafa-f9f4-4afe-aa52-7d281ae9a647 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:53.503267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-28a0eafa-f9f4-4afe-aa52-7d281ae9a647 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:53.503756 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-28a0eafa-f9f4-4afe-aa52-7d281ae9a647 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:53.504909 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-28a0eafa-f9f4-4afe-aa52-7d281ae9a647 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:53.505060 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-28a0eafa-f9f4-4afe-aa52-7d281ae9a647 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:53.644746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-28a0eafa-f9f4-4afe-aa52-7d281ae9a647 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:53.652309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-28a0eafa-f9f4-4afe-aa52-7d281ae9a647 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1576 microversion: 2.1 time: 0.160206 Jul 01 16:46:53.652877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 400/798] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:53 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:54.361868 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c05edc7a-20a8-41e7-ad31-218a499d3f84 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:54.362402 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c05edc7a-20a8-41e7-ad31-218a499d3f84 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:54.370502 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c05edc7a-20a8-41e7-ad31-218a499d3f84 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:54.371110 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c05edc7a-20a8-41e7-ad31-218a499d3f84 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:54.372254 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c05edc7a-20a8-41e7-ad31-218a499d3f84 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:54.372697 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c05edc7a-20a8-41e7-ad31-218a499d3f84 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:54.459677 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-c05edc7a-20a8-41e7-ad31-218a499d3f84 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lazy-loading 'services' on Instance uuid 065f34be-ae7e-43dc-8ff4-9656de8e4f9b {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:46:54.541539 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c05edc7a-20a8-41e7-ad31-218a499d3f84 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "DELETE /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b/os-volume_attachments/a947ca5d-2fcf-49a2-89cc-20c58b0c94d4" status: 202 len: 0 microversion: 2.1 time: 0.183486 Jul 01 16:46:54.542544 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 399/799] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 1 16:46:54 2022] DELETE /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b/os-volume_attachments/a947ca5d-2fcf-49a2-89cc-20c58b0c94d4 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:46:54.553631 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-366c86c0-7ce5-48af-866c-10028a7d1247 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:54.554601 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-366c86c0-7ce5-48af-866c-10028a7d1247 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:54.561584 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-366c86c0-7ce5-48af-866c-10028a7d1247 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:54.562033 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-366c86c0-7ce5-48af-866c-10028a7d1247 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:54.562839 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-366c86c0-7ce5-48af-866c-10028a7d1247 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:54.563275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-366c86c0-7ce5-48af-866c-10028a7d1247 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:54.595535 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-366c86c0-7ce5-48af-866c-10028a7d1247 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048158 Jul 01 16:46:54.596100 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 401/800] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 1 16:46:54 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:46:54.670417 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ab9319f2-462a-47ab-8afd-ba89b0e6483b tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:54.671306 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ab9319f2-462a-47ab-8afd-ba89b0e6483b tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:54.679957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ab9319f2-462a-47ab-8afd-ba89b0e6483b tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:54.680570 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ab9319f2-462a-47ab-8afd-ba89b0e6483b tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:54.681556 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ab9319f2-462a-47ab-8afd-ba89b0e6483b tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:54.682128 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ab9319f2-462a-47ab-8afd-ba89b0e6483b tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:54.834801 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ab9319f2-462a-47ab-8afd-ba89b0e6483b tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:54.843447 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ab9319f2-462a-47ab-8afd-ba89b0e6483b tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1576 microversion: 2.1 time: 0.177666 Jul 01 16:46:54.846389 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 400/801] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:54 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:55.607644 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-dea4a14e-4326-4410-8d29-6a74588b9590 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:55.608591 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-dea4a14e-4326-4410-8d29-6a74588b9590 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:55.616022 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dea4a14e-4326-4410-8d29-6a74588b9590 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:55.616470 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dea4a14e-4326-4410-8d29-6a74588b9590 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:55.617241 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dea4a14e-4326-4410-8d29-6a74588b9590 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:55.617865 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dea4a14e-4326-4410-8d29-6a74588b9590 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:55.651691 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-dea4a14e-4326-4410-8d29-6a74588b9590 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047799 Jul 01 16:46:55.655713 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 402/802] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 1 16:46:55 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:46:55.861318 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5770786c-c9b2-4efa-ba75-70ac6c4cce8c tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:55.861904 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5770786c-c9b2-4efa-ba75-70ac6c4cce8c tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:55.868632 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5770786c-c9b2-4efa-ba75-70ac6c4cce8c tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:55.869071 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5770786c-c9b2-4efa-ba75-70ac6c4cce8c tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:55.869826 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5770786c-c9b2-4efa-ba75-70ac6c4cce8c tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:55.870255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5770786c-c9b2-4efa-ba75-70ac6c4cce8c tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:56.005341 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5770786c-c9b2-4efa-ba75-70ac6c4cce8c tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:56.012897 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5770786c-c9b2-4efa-ba75-70ac6c4cce8c tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1576 microversion: 2.1 time: 0.155624 Jul 01 16:46:56.013479 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 401/803] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:55 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:56.663840 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3dc2fcb5-fdaa-4fcb-8795-db4f71361f0d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:56.664879 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3dc2fcb5-fdaa-4fcb-8795-db4f71361f0d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:56.671477 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3dc2fcb5-fdaa-4fcb-8795-db4f71361f0d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:56.671925 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3dc2fcb5-fdaa-4fcb-8795-db4f71361f0d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:56.672691 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3dc2fcb5-fdaa-4fcb-8795-db4f71361f0d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:56.673125 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3dc2fcb5-fdaa-4fcb-8795-db4f71361f0d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:56.702403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3dc2fcb5-fdaa-4fcb-8795-db4f71361f0d tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043038 Jul 01 16:46:56.702976 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 403/804] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 1 16:46:56 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 16:46:56.765108 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c0f5f4c8-e2a9-4bf6-b846-aa2af73a0520 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:56.765931 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c0f5f4c8-e2a9-4bf6-b846-aa2af73a0520 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:56.773185 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c0f5f4c8-e2a9-4bf6-b846-aa2af73a0520 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:56.773649 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c0f5f4c8-e2a9-4bf6-b846-aa2af73a0520 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:56.774460 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c0f5f4c8-e2a9-4bf6-b846-aa2af73a0520 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:56.774904 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c0f5f4c8-e2a9-4bf6-b846-aa2af73a0520 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:56.805291 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c0f5f4c8-e2a9-4bf6-b846-aa2af73a0520 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 16:46:56.899625 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c0f5f4c8-e2a9-4bf6-b846-aa2af73a0520 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "DELETE /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b" status: 204 len: 0 microversion: 2.1 time: 0.138081 Jul 01 16:46:56.901954 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 402/805] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:46:56 2022] DELETE /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 16:46:56.912797 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c9beeea9-dd1b-45be-a706-73b0d4444b60 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:56.913500 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c9beeea9-dd1b-45be-a706-73b0d4444b60 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:56.919908 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c9beeea9-dd1b-45be-a706-73b0d4444b60 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:56.920345 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c9beeea9-dd1b-45be-a706-73b0d4444b60 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:56.921105 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c9beeea9-dd1b-45be-a706-73b0d4444b60 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:56.921531 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c9beeea9-dd1b-45be-a706-73b0d4444b60 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:57.037419 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d18de86d-93d2-4b4a-b9eb-56ccc3a5f367 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:57.038473 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d18de86d-93d2-4b4a-b9eb-56ccc3a5f367 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:57.047853 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d18de86d-93d2-4b4a-b9eb-56ccc3a5f367 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:57.048522 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d18de86d-93d2-4b4a-b9eb-56ccc3a5f367 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:57.050124 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d18de86d-93d2-4b4a-b9eb-56ccc3a5f367 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:57.052040 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d18de86d-93d2-4b4a-b9eb-56ccc3a5f367 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:57.077556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c9beeea9-dd1b-45be-a706-73b0d4444b60 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:57.089208 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c9beeea9-dd1b-45be-a706-73b0d4444b60 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b" status: 200 len: 1683 microversion: 2.1 time: 0.181105 Jul 01 16:46:57.097658 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 404/806] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:56 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:57.204198 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d18de86d-93d2-4b4a-b9eb-56ccc3a5f367 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:57.213380 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d18de86d-93d2-4b4a-b9eb-56ccc3a5f367 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1576 microversion: 2.1 time: 0.186067 Jul 01 16:46:57.213957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 403/807] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:57 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:58.107687 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-dc571883-9241-4c09-af82-aac4051f21ea tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:58.108286 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-dc571883-9241-4c09-af82-aac4051f21ea tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:58.115721 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dc571883-9241-4c09-af82-aac4051f21ea tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:58.116167 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dc571883-9241-4c09-af82-aac4051f21ea tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:58.116924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dc571883-9241-4c09-af82-aac4051f21ea tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:58.117358 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dc571883-9241-4c09-af82-aac4051f21ea tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:58.231502 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e39f15d0-0853-460f-b120-0829ac3c0f12 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:58.232091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e39f15d0-0853-460f-b120-0829ac3c0f12 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:58.239788 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e39f15d0-0853-460f-b120-0829ac3c0f12 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:58.240240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e39f15d0-0853-460f-b120-0829ac3c0f12 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:58.241019 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e39f15d0-0853-460f-b120-0829ac3c0f12 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:58.241458 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e39f15d0-0853-460f-b120-0829ac3c0f12 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:58.246648 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-dc571883-9241-4c09-af82-aac4051f21ea tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:58.252832 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-dc571883-9241-4c09-af82-aac4051f21ea tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b" status: 200 len: 1683 microversion: 2.1 time: 0.148974 Jul 01 16:46:58.253803 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 405/808] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:58 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:58.372718 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e39f15d0-0853-460f-b120-0829ac3c0f12 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:58.380142 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e39f15d0-0853-460f-b120-0829ac3c0f12 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1576 microversion: 2.1 time: 0.152556 Jul 01 16:46:58.380713 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 404/809] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:58 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:46:59.139807 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-4312601f-75d3-41dd-9180-f2f7c5ddb5f4 req-b5104e99-94a8-4c31-bfa4-d1339432c391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "602a9841-5b03-4f60-b3be-7c4efe7cd9ef", "name": "network-vif-plugged", "status": "completed", "tag": "dfaabde7-2cdd-46ea-9860-694b36767f5e"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:46:59.148650 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-4312601f-75d3-41dd-9180-f2f7c5ddb5f4 req-b5104e99-94a8-4c31-bfa4-d1339432c391 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:59.149104 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-4312601f-75d3-41dd-9180-f2f7c5ddb5f4 req-b5104e99-94a8-4c31-bfa4-d1339432c391 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:59.161197 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-4312601f-75d3-41dd-9180-f2f7c5ddb5f4 req-b5104e99-94a8-4c31-bfa4-d1339432c391 service nova] Creating event network-vif-plugged:dfaabde7-2cdd-46ea-9860-694b36767f5e for instance 602a9841-5b03-4f60-b3be-7c4efe7cd9ef on hv-cinder-79760 Jul 01 16:46:59.166215 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-4312601f-75d3-41dd-9180-f2f7c5ddb5f4 req-b5104e99-94a8-4c31-bfa4-d1339432c391 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030096 Jul 01 16:46:59.166866 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 406/810] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:46:59.270947 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d2941bb8-4d57-4851-bb39-c7828ec01ef3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:59.271648 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d2941bb8-4d57-4851-bb39-c7828ec01ef3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:59.278136 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d2941bb8-4d57-4851-bb39-c7828ec01ef3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:59.278615 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d2941bb8-4d57-4851-bb39-c7828ec01ef3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:59.279394 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d2941bb8-4d57-4851-bb39-c7828ec01ef3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:59.279843 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d2941bb8-4d57-4851-bb39-c7828ec01ef3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:59.398143 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4619154e-1cd6-4bf6-a466-8d734f43dd86 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:46:59.398874 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4619154e-1cd6-4bf6-a466-8d734f43dd86 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:46:59.405285 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4619154e-1cd6-4bf6-a466-8d734f43dd86 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:59.405971 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4619154e-1cd6-4bf6-a466-8d734f43dd86 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:59.406774 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4619154e-1cd6-4bf6-a466-8d734f43dd86 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:46:59.407213 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4619154e-1cd6-4bf6-a466-8d734f43dd86 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:46:59.414987 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d2941bb8-4d57-4851-bb39-c7828ec01ef3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:59.422400 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d2941bb8-4d57-4851-bb39-c7828ec01ef3 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b" status: 200 len: 1683 microversion: 2.1 time: 0.155865 Jul 01 16:46:59.423174 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 405/811] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:59 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:46:59.548567 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4619154e-1cd6-4bf6-a466-8d734f43dd86 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:46:59.557589 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4619154e-1cd6-4bf6-a466-8d734f43dd86 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1576 microversion: 2.1 time: 0.164356 Jul 01 16:46:59.558160 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 407/812] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:46:59 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:47:00.441478 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-40f4e91c-83e2-4b30-a223-97be6256635a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:00.442092 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-40f4e91c-83e2-4b30-a223-97be6256635a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:00.448835 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-40f4e91c-83e2-4b30-a223-97be6256635a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:00.449550 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-40f4e91c-83e2-4b30-a223-97be6256635a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:00.450540 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-40f4e91c-83e2-4b30-a223-97be6256635a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:00.451188 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-40f4e91c-83e2-4b30-a223-97be6256635a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:00.574804 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9ce8d7c8-3f28-477a-8e6a-e28e34eb5d73 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:00.575571 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-9ce8d7c8-3f28-477a-8e6a-e28e34eb5d73 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:00.583154 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9ce8d7c8-3f28-477a-8e6a-e28e34eb5d73 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:00.583869 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9ce8d7c8-3f28-477a-8e6a-e28e34eb5d73 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:00.584721 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9ce8d7c8-3f28-477a-8e6a-e28e34eb5d73 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:00.585229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9ce8d7c8-3f28-477a-8e6a-e28e34eb5d73 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:00.742731 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-40f4e91c-83e2-4b30-a223-97be6256635a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:00.749960 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-40f4e91c-83e2-4b30-a223-97be6256635a tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b" status: 200 len: 1683 microversion: 2.1 time: 0.312696 Jul 01 16:47:00.750556 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 406/813] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:00 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b => generated 1683 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:01.093603 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9ce8d7c8-3f28-477a-8e6a-e28e34eb5d73 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:01.103232 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9ce8d7c8-3f28-477a-8e6a-e28e34eb5d73 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1576 microversion: 2.1 time: 0.532474 Jul 01 16:47:01.103825 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 408/814] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:00 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1576 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:47:01.704629 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-d832ba77-7f28-4b07-84fd-0d29553de933 req-57774d15-5382-4a8a-9365-2a3113902e2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "065f34be-ae7e-43dc-8ff4-9656de8e4f9b", "name": "network-vif-deleted", "tag": "e1d9786d-77cd-467e-a907-5d453b790339"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:47:01.714024 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-d832ba77-7f28-4b07-84fd-0d29553de933 req-57774d15-5382-4a8a-9365-2a3113902e2c service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:01.714583 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-d832ba77-7f28-4b07-84fd-0d29553de933 req-57774d15-5382-4a8a-9365-2a3113902e2c service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:01.726210 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-d832ba77-7f28-4b07-84fd-0d29553de933 req-57774d15-5382-4a8a-9365-2a3113902e2c service nova] Creating event network-vif-deleted:e1d9786d-77cd-467e-a907-5d453b790339 for instance 065f34be-ae7e-43dc-8ff4-9656de8e4f9b on hv-cinder-79760 Jul 01 16:47:01.731069 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-d832ba77-7f28-4b07-84fd-0d29553de933 req-57774d15-5382-4a8a-9365-2a3113902e2c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030005 Jul 01 16:47:01.731715 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 407/815] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:47:01.767567 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-54064991-157c-4c65-85bd-ef8a8d76a67f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:01.769672 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-54064991-157c-4c65-85bd-ef8a8d76a67f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:01.776361 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-54064991-157c-4c65-85bd-ef8a8d76a67f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:01.776811 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-54064991-157c-4c65-85bd-ef8a8d76a67f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:01.777632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-54064991-157c-4c65-85bd-ef8a8d76a67f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:01.778250 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-54064991-157c-4c65-85bd-ef8a8d76a67f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:01.782778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=100 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:47:01.855331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-54064991-157c-4c65-85bd-ef8a8d76a67f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4da21fbfa3472cac6e766a2f4799d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5747a83d930f4075a78e9b14abd58c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:01.866892 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-54064991-157c-4c65-85bd-ef8a8d76a67f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b" status: 200 len: 1616 microversion: 2.1 time: 0.103467 Jul 01 16:47:01.868175 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 409/816] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:01 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b => generated 1616 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:47:02.121975 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4957c810-c83f-486a-b905-8e779f7965fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:02.122991 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4957c810-c83f-486a-b905-8e779f7965fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:02.131813 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4957c810-c83f-486a-b905-8e779f7965fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:02.132597 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4957c810-c83f-486a-b905-8e779f7965fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:02.133659 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4957c810-c83f-486a-b905-8e779f7965fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:02.134262 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4957c810-c83f-486a-b905-8e779f7965fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:02.279270 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4957c810-c83f-486a-b905-8e779f7965fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:02.288250 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4957c810-c83f-486a-b905-8e779f7965fc tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1563 microversion: 2.1 time: 0.171068 Jul 01 16:47:02.288835 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 408/817] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:02 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:02.885495 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f473b24e-d8ab-4e5b-b436-12b4a8681aec tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:02.886379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f473b24e-d8ab-4e5b-b436-12b4a8681aec tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:02.893728 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f473b24e-d8ab-4e5b-b436-12b4a8681aec tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:02.894870 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f473b24e-d8ab-4e5b-b436-12b4a8681aec tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:02.895922 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f473b24e-d8ab-4e5b-b436-12b4a8681aec tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:02.896584 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f473b24e-d8ab-4e5b-b436-12b4a8681aec tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:02.913551 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-f473b24e-d8ab-4e5b-b436-12b4a8681aec tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] HTTP exception thrown: Instance 065f34be-ae7e-43dc-8ff4-9656de8e4f9b could not be found. Jul 01 16:47:02.915516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f473b24e-d8ab-4e5b-b436-12b4a8681aec tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Request method failure captured: Jul 01 16:47:02.915516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b HTTP/1.1 Jul 01 16:47:02.915516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:47:02.915516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:47:02.915516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:47:02.915516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:47:02.915516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:47:02.915516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:47:02.915516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:47:02.915516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:47:02.915516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyN28kRS6gk46UU5wMmPqqrbKCAlsLmUAL51tGA7XZ2wRJWF2nXTu75kTgDFZ7hA4wbbjyjFuM6MIxqsPPN7wq3gn9HT9lV3kgc_ncS5tAqdDIsXq38bqSWgq9ddXJaghqMv_F2GaWnIjXUUxQMmZS8lrawCYahe-iQxu0RYfE47KKI Jul 01 16:47:02.915516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:47:02.915516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:47:02.915516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:47:02.915516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:47:02.915516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:47:02.915516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:47:02.915516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:47:02.915516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:02.915516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:47:02.915516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:47:02.916994 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:47:02.916994 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:02.916994 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:47:02.916994 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:02.916994 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:47:02.916994 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:47:02.916994 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:47:02.916994 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: 7c4da21fbfa3472cac6e766a2f4799d8 Jul 01 16:47:02.916994 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:47:02.916994 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:47:02.916994 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance 065f34be-ae7e-43dc-8ff4-9656de8e4f9b could not be found. Jul 01 16:47:02.916994 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': '065f34be-ae7e-43dc-8ff4-9656de8e4f9b'} Jul 01 16:47:02.917779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:47:02.917779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:02.917779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:47:02.917779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:47:02.917779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:47:02.917779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:47:02.917779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:47:02.917779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:47:02.917779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:47:02.917779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:47:02.917779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 065f34be-ae7e-43dc-8ff4-9656de8e4f9b could not be found. Jul 01 16:47:02.917779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:02.917779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:02.917779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:02.917779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:02.917779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:02.917779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:02.917779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:47:02.917779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:47:02.917779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:47:02.919110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:47:02.919110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:47:02.919110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:47:02.919110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:47:02.919110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:47:02.919110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:47:02.919110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:47:02.919110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 065f34be-ae7e-43dc-8ff4-9656de8e4f9b could not be found. Jul 01 16:47:02.919110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:02.919110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:02.919110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:02.919110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:02.919110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:02.919110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:02.919110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:47:02.919110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:47:02.919110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 065f34be-ae7e-43dc-8ff4-9656de8e4f9b could not be found. Jul 01 16:47:02.919110 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:02.920292 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f473b24e-d8ab-4e5b-b436-12b4a8681aec tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Returning 404 to user: Instance 065f34be-ae7e-43dc-8ff4-9656de8e4f9b could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:47:02.920292 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f473b24e-d8ab-4e5b-b436-12b4a8681aec tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b" status: 404 len: 111 microversion: 2.1 time: 0.035706 Jul 01 16:47:02.921537 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 410/818] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:02 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:47:02.927601 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-705f581a-7ba9-4d88-af1d-1c3dffbcc516 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '.version_select at 0x7fa85f363820>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:02.949082 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-705f581a-7ba9-4d88-af1d-1c3dffbcc516 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219704145" status: 202 len: 0 microversion: 2.1 time: 0.026302 Jul 01 16:47:02.953287 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 409/819] 10.222.0.57 () {58 vars in 1220 bytes} [Fri Jul 1 16:47:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219704145 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:47:04.758894 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f8ecec4d-489a-4efe-b67d-c8299d87a311 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:04.759382 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f8ecec4d-489a-4efe-b67d-c8299d87a311 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:04.766012 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f8ecec4d-489a-4efe-b67d-c8299d87a311 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:04.766488 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f8ecec4d-489a-4efe-b67d-c8299d87a311 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:04.767240 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f8ecec4d-489a-4efe-b67d-c8299d87a311 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:04.767696 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f8ecec4d-489a-4efe-b67d-c8299d87a311 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:04.781662 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-f8ecec4d-489a-4efe-b67d-c8299d87a311 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] HTTP exception thrown: Instance 065f34be-ae7e-43dc-8ff4-9656de8e4f9b could not be found. Jul 01 16:47:04.783217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f8ecec4d-489a-4efe-b67d-c8299d87a311 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Request method failure captured: Jul 01 16:47:04.783217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: DELETE /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b HTTP/1.1 Jul 01 16:47:04.783217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:47:04.783217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:47:04.783217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:47:04.783217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:47:04.783217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:47:04.783217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:47:04.783217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:47:04.783217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:47:04.783217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyN28kRS6gk46UU5wMmPqqrbKCAlsLmUAL51tGA7XZ2wRJWF2nXTu75kTgDFZ7hA4wbbjyjFuM6MIxqsPPN7wq3gn9HT9lV3kgc_ncS5tAqdDIsXq38bqSWgq9ddXJaghqMv_F2GaWnIjXUUxQMmZS8lrawCYahe-iQxu0RYfE47KKI Jul 01 16:47:04.783217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:47:04.783217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:47:04.783217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:47:04.783217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:47:04.783217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:47:04.783217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:47:04.783217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:47:04.783217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:04.783217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:47:04.783217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:47:04.784607 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:47:04.784607 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:04.784607 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:47:04.784607 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:04.784607 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:47:04.784607 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:47:04.784607 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:47:04.784607 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: 7c4da21fbfa3472cac6e766a2f4799d8 Jul 01 16:47:04.784607 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:47:04.784607 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:47:04.784607 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance 065f34be-ae7e-43dc-8ff4-9656de8e4f9b could not be found. Jul 01 16:47:04.784607 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': '065f34be-ae7e-43dc-8ff4-9656de8e4f9b'} Jul 01 16:47:04.785380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:47:04.785380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:04.785380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:47:04.785380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:47:04.785380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:47:04.785380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:47:04.785380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:47:04.785380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:47:04.785380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:47:04.785380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:47:04.785380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 065f34be-ae7e-43dc-8ff4-9656de8e4f9b could not be found. Jul 01 16:47:04.785380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:04.785380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:04.785380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:04.785380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:04.785380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:04.785380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:04.785380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:47:04.785380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:47:04.785380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:47:04.786643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:47:04.786643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 16:47:04.786643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 16:47:04.786643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 16:47:04.786643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 16:47:04.786643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:47:04.786643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:47:04.786643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:47:04.786643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:47:04.786643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 065f34be-ae7e-43dc-8ff4-9656de8e4f9b could not be found. Jul 01 16:47:04.786643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:04.786643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:04.786643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:04.786643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:04.786643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:04.786643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:04.786643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:47:04.786643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:47:04.786643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 065f34be-ae7e-43dc-8ff4-9656de8e4f9b could not be found. Jul 01 16:47:04.786643 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:04.788116 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f8ecec4d-489a-4efe-b67d-c8299d87a311 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Returning 404 to user: Instance 065f34be-ae7e-43dc-8ff4-9656de8e4f9b could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:47:04.788116 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f8ecec4d-489a-4efe-b67d-c8299d87a311 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "DELETE /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b" status: 404 len: 111 microversion: 2.1 time: 0.029543 Jul 01 16:47:04.788116 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 411/820] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:47:04 2022] DELETE /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:47:04.793207 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-930d055f-cd5a-4239-9e1e-09c3a681e756 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:04.793814 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-930d055f-cd5a-4239-9e1e-09c3a681e756 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 065f34be-ae7e-43dc-8ff4-9656de8e4f9b] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:04.801886 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-930d055f-cd5a-4239-9e1e-09c3a681e756 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:04.802334 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-930d055f-cd5a-4239-9e1e-09c3a681e756 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:04.803169 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-930d055f-cd5a-4239-9e1e-09c3a681e756 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:04.803611 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-930d055f-cd5a-4239-9e1e-09c3a681e756 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:04.817469 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-930d055f-cd5a-4239-9e1e-09c3a681e756 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] HTTP exception thrown: Instance 065f34be-ae7e-43dc-8ff4-9656de8e4f9b could not be found. Jul 01 16:47:04.819137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-930d055f-cd5a-4239-9e1e-09c3a681e756 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Request method failure captured: Jul 01 16:47:04.819137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b HTTP/1.1 Jul 01 16:47:04.819137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:47:04.819137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:47:04.819137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:47:04.819137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:47:04.819137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:47:04.819137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:47:04.819137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:47:04.819137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:47:04.819137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyN28kRS6gk46UU5wMmPqqrbKCAlsLmUAL51tGA7XZ2wRJWF2nXTu75kTgDFZ7hA4wbbjyjFuM6MIxqsPPN7wq3gn9HT9lV3kgc_ncS5tAqdDIsXq38bqSWgq9ddXJaghqMv_F2GaWnIjXUUxQMmZS8lrawCYahe-iQxu0RYfE47KKI Jul 01 16:47:04.819137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:47:04.819137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:47:04.819137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:47:04.819137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:47:04.819137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:47:04.819137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:47:04.819137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:47:04.819137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:04.819137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:47:04.819137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:47:04.820668 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:47:04.820668 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:04.820668 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:47:04.820668 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:04.820668 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:47:04.820668 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:47:04.820668 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:47:04.820668 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: 7c4da21fbfa3472cac6e766a2f4799d8 Jul 01 16:47:04.820668 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:47:04.820668 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: > Jul 01 16:47:04.820668 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Instance 065f34be-ae7e-43dc-8ff4-9656de8e4f9b could not be found. Jul 01 16:47:04.820668 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'id': '065f34be-ae7e-43dc-8ff4-9656de8e4f9b'} Jul 01 16:47:04.821644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:47:04.821644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:04.821644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:47:04.821644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:47:04.821644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:47:04.821644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:47:04.821644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:47:04.821644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:47:04.821644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:47:04.821644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:47:04.821644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 065f34be-ae7e-43dc-8ff4-9656de8e4f9b could not be found. Jul 01 16:47:04.821644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:04.821644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:04.821644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:04.821644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:04.821644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:04.821644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:04.821644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:47:04.821644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:47:04.821644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:47:04.823314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:47:04.823314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:47:04.823314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:47:04.823314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:47:04.823314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:47:04.823314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:47:04.823314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:47:04.823314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 065f34be-ae7e-43dc-8ff4-9656de8e4f9b could not be found. Jul 01 16:47:04.823314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:04.823314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:04.823314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:04.823314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:04.823314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:04.823314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:04.823314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:47:04.823314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:47:04.823314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 065f34be-ae7e-43dc-8ff4-9656de8e4f9b could not be found. Jul 01 16:47:04.823314 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:04.825251 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-930d055f-cd5a-4239-9e1e-09c3a681e756 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Returning 404 to user: Instance 065f34be-ae7e-43dc-8ff4-9656de8e4f9b could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:47:04.825251 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-930d055f-cd5a-4239-9e1e-09c3a681e756 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b" status: 404 len: 111 microversion: 2.1 time: 0.031094 Jul 01 16:47:04.825251 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 410/821] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:04 2022] GET /compute/v2.1/servers/065f34be-ae7e-43dc-8ff4-9656de8e4f9b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:47:05.952821 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-86fd3317-1a6c-4683-87ee-ceffb487e759 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:05.953391 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-86fd3317-1a6c-4683-87ee-ceffb487e759 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:05.960387 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-86fd3317-1a6c-4683-87ee-ceffb487e759 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:05.960829 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-86fd3317-1a6c-4683-87ee-ceffb487e759 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:05.961583 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-86fd3317-1a6c-4683-87ee-ceffb487e759 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:05.962015 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-86fd3317-1a6c-4683-87ee-ceffb487e759 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:05.976270 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-86fd3317-1a6c-4683-87ee-ceffb487e759 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] HTTP exception thrown: Instance 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d could not be found. Jul 01 16:47:05.977782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-86fd3317-1a6c-4683-87ee-ceffb487e759 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Request method failure captured: Jul 01 16:47:05.977782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: DELETE /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d HTTP/1.1 Jul 01 16:47:05.977782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:47:05.977782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:47:05.977782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:47:05.977782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:47:05.977782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:47:05.977782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:47:05.977782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:47:05.977782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:47:05.977782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyN28kRS6gk46UU5wMmPqqrbKCAlsLmUAL51tGA7XZ2wRJWF2nXTu75kTgDFZ7hA4wbbjyjFuM6MIxqsPPN7wq3gn9HT9lV3kgc_ncS5tAqdDIsXq38bqSWgq9ddXJaghqMv_F2GaWnIjXUUxQMmZS8lrawCYahe-iQxu0RYfE47KKI Jul 01 16:47:05.977782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:47:05.977782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:47:05.977782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:47:05.977782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:47:05.977782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:47:05.977782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:47:05.977782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:47:05.977782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:05.977782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:47:05.977782 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:47:05.979383 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:47:05.979383 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:05.979383 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:47:05.979383 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:05.979383 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:47:05.979383 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:47:05.979383 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:47:05.979383 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: 7c4da21fbfa3472cac6e766a2f4799d8 Jul 01 16:47:05.979383 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:47:05.979383 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:47:05.979383 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d could not be found. Jul 01 16:47:05.979383 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': '4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d'} Jul 01 16:47:05.980229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:47:05.980229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:05.980229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:47:05.980229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:47:05.980229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:47:05.980229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:47:05.980229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:47:05.980229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:47:05.980229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:47:05.980229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:47:05.980229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d could not be found. Jul 01 16:47:05.980229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:05.980229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:05.980229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:05.980229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:05.980229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:05.980229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:05.980229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:47:05.980229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:47:05.980229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:47:05.981459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:47:05.981459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 16:47:05.981459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 16:47:05.981459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 16:47:05.981459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 16:47:05.981459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:47:05.981459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:47:05.981459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:47:05.981459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:47:05.981459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d could not be found. Jul 01 16:47:05.981459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:05.981459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:05.981459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:05.981459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:05.981459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:05.981459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:05.981459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:47:05.981459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:47:05.981459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d could not be found. Jul 01 16:47:05.981459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:05.982789 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-86fd3317-1a6c-4683-87ee-ceffb487e759 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Returning 404 to user: Instance 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:47:05.982789 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-86fd3317-1a6c-4683-87ee-ceffb487e759 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 404 len: 111 microversion: 2.1 time: 0.030336 Jul 01 16:47:05.982789 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 412/822] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:47:05 2022] DELETE /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:47:05.988122 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1332f710-2cd4-4a75-a298-26efc1f78c8e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:05.988734 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1332f710-2cd4-4a75-a298-26efc1f78c8e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:05.995141 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1332f710-2cd4-4a75-a298-26efc1f78c8e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:05.995584 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1332f710-2cd4-4a75-a298-26efc1f78c8e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:05.996337 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1332f710-2cd4-4a75-a298-26efc1f78c8e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:05.996765 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1332f710-2cd4-4a75-a298-26efc1f78c8e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:06.009921 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-1332f710-2cd4-4a75-a298-26efc1f78c8e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] HTTP exception thrown: Instance 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d could not be found. Jul 01 16:47:06.011434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1332f710-2cd4-4a75-a298-26efc1f78c8e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Request method failure captured: Jul 01 16:47:06.011434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d HTTP/1.1 Jul 01 16:47:06.011434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:47:06.011434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:47:06.011434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:47:06.011434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:47:06.011434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:47:06.011434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:47:06.011434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:47:06.011434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:47:06.011434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyN28kRS6gk46UU5wMmPqqrbKCAlsLmUAL51tGA7XZ2wRJWF2nXTu75kTgDFZ7hA4wbbjyjFuM6MIxqsPPN7wq3gn9HT9lV3kgc_ncS5tAqdDIsXq38bqSWgq9ddXJaghqMv_F2GaWnIjXUUxQMmZS8lrawCYahe-iQxu0RYfE47KKI Jul 01 16:47:06.011434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:47:06.011434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:47:06.011434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:47:06.011434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:47:06.011434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:47:06.011434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:47:06.011434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:47:06.011434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:06.011434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:47:06.011434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:47:06.012986 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:47:06.012986 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:06.012986 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:47:06.012986 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:06.012986 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:47:06.012986 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:47:06.012986 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:47:06.012986 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: 7c4da21fbfa3472cac6e766a2f4799d8 Jul 01 16:47:06.012986 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:47:06.012986 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: > Jul 01 16:47:06.012986 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Instance 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d could not be found. Jul 01 16:47:06.012986 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'id': '4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d'} Jul 01 16:47:06.013773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:47:06.013773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:06.013773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:47:06.013773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:47:06.013773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:47:06.013773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:47:06.013773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:47:06.013773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:47:06.013773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:47:06.013773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:47:06.013773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d could not be found. Jul 01 16:47:06.013773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:06.013773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:06.013773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:06.013773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:06.013773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:06.013773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:06.013773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:47:06.013773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:47:06.013773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:47:06.015038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:47:06.015038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:47:06.015038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:47:06.015038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:47:06.015038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:47:06.015038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:47:06.015038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:47:06.015038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d could not be found. Jul 01 16:47:06.015038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:06.015038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:06.015038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:06.015038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:06.015038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:06.015038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:06.015038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:47:06.015038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:47:06.015038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d could not be found. Jul 01 16:47:06.015038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:06.016148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1332f710-2cd4-4a75-a298-26efc1f78c8e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Returning 404 to user: Instance 4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:47:06.016148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1332f710-2cd4-4a75-a298-26efc1f78c8e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d" status: 404 len: 111 microversion: 2.1 time: 0.028739 Jul 01 16:47:06.016148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 411/823] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:05 2022] GET /compute/v2.1/servers/4d96bcc7-6ebf-4c8b-ad33-719cd2f7ad7d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:47:06.021807 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3faf79d7-36e3-44e1-a4b5-10c1e0c1bc6e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:06.022288 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3faf79d7-36e3-44e1-a4b5-10c1e0c1bc6e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:06.028276 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3faf79d7-36e3-44e1-a4b5-10c1e0c1bc6e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:06.028716 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3faf79d7-36e3-44e1-a4b5-10c1e0c1bc6e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:06.029460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3faf79d7-36e3-44e1-a4b5-10c1e0c1bc6e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:06.029894 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3faf79d7-36e3-44e1-a4b5-10c1e0c1bc6e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:06.043648 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-3faf79d7-36e3-44e1-a4b5-10c1e0c1bc6e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] HTTP exception thrown: Instance d475a49d-1ee9-4cb0-aaea-507155a02204 could not be found. Jul 01 16:47:06.045157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3faf79d7-36e3-44e1-a4b5-10c1e0c1bc6e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Request method failure captured: Jul 01 16:47:06.045157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: DELETE /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 HTTP/1.1 Jul 01 16:47:06.045157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:47:06.045157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:47:06.045157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:47:06.045157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:47:06.045157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:47:06.045157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:47:06.045157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:47:06.045157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:47:06.045157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyN28kRS6gk46UU5wMmPqqrbKCAlsLmUAL51tGA7XZ2wRJWF2nXTu75kTgDFZ7hA4wbbjyjFuM6MIxqsPPN7wq3gn9HT9lV3kgc_ncS5tAqdDIsXq38bqSWgq9ddXJaghqMv_F2GaWnIjXUUxQMmZS8lrawCYahe-iQxu0RYfE47KKI Jul 01 16:47:06.045157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:47:06.045157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:47:06.045157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:47:06.045157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:47:06.045157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:47:06.045157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:47:06.045157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:47:06.045157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:06.045157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:47:06.045157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:47:06.046762 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:47:06.046762 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:06.046762 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:47:06.046762 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:06.046762 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:47:06.046762 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:47:06.046762 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:47:06.046762 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: 7c4da21fbfa3472cac6e766a2f4799d8 Jul 01 16:47:06.046762 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:47:06.046762 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:47:06.046762 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance d475a49d-1ee9-4cb0-aaea-507155a02204 could not be found. Jul 01 16:47:06.046762 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': 'd475a49d-1ee9-4cb0-aaea-507155a02204'} Jul 01 16:47:06.049979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:47:06.049979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:06.049979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:47:06.049979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:47:06.049979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:47:06.049979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:47:06.049979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:47:06.049979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:47:06.049979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:47:06.049979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:47:06.049979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d475a49d-1ee9-4cb0-aaea-507155a02204 could not be found. Jul 01 16:47:06.049979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:06.049979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:06.049979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:06.049979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:06.049979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:06.049979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:06.049979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:47:06.049979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:47:06.049979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:47:06.051373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:47:06.051373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 16:47:06.051373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 16:47:06.051373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 16:47:06.051373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 16:47:06.051373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:47:06.051373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:47:06.051373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:47:06.051373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:47:06.051373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d475a49d-1ee9-4cb0-aaea-507155a02204 could not be found. Jul 01 16:47:06.051373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:06.051373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:06.051373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:06.051373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:06.051373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:06.051373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:06.051373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:47:06.051373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:47:06.051373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d475a49d-1ee9-4cb0-aaea-507155a02204 could not be found. Jul 01 16:47:06.051373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:06.052559 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3faf79d7-36e3-44e1-a4b5-10c1e0c1bc6e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Returning 404 to user: Instance d475a49d-1ee9-4cb0-aaea-507155a02204 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:47:06.052559 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3faf79d7-36e3-44e1-a4b5-10c1e0c1bc6e tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 404 len: 111 microversion: 2.1 time: 0.029062 Jul 01 16:47:06.052559 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 413/824] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:47:06 2022] DELETE /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 16:47:06.055112 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9d428ffa-5bd5-4ab6-af41-ce46b70610dc tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:06.055728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9d428ffa-5bd5-4ab6-af41-ce46b70610dc tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: d475a49d-1ee9-4cb0-aaea-507155a02204] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:06.061728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9d428ffa-5bd5-4ab6-af41-ce46b70610dc tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:06.062181 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9d428ffa-5bd5-4ab6-af41-ce46b70610dc tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:06.062986 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9d428ffa-5bd5-4ab6-af41-ce46b70610dc tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:06.063427 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9d428ffa-5bd5-4ab6-af41-ce46b70610dc tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:06.076730 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-9d428ffa-5bd5-4ab6-af41-ce46b70610dc tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] HTTP exception thrown: Instance d475a49d-1ee9-4cb0-aaea-507155a02204 could not be found. Jul 01 16:47:06.078208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9d428ffa-5bd5-4ab6-af41-ce46b70610dc tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Request method failure captured: Jul 01 16:47:06.078208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 HTTP/1.1 Jul 01 16:47:06.078208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:47:06.078208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:47:06.078208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:47:06.078208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:47:06.078208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:47:06.078208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:47:06.078208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:47:06.078208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:47:06.078208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyN28kRS6gk46UU5wMmPqqrbKCAlsLmUAL51tGA7XZ2wRJWF2nXTu75kTgDFZ7hA4wbbjyjFuM6MIxqsPPN7wq3gn9HT9lV3kgc_ncS5tAqdDIsXq38bqSWgq9ddXJaghqMv_F2GaWnIjXUUxQMmZS8lrawCYahe-iQxu0RYfE47KKI Jul 01 16:47:06.078208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:47:06.078208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:47:06.078208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:47:06.078208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:47:06.078208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:47:06.078208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:47:06.078208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:47:06.078208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:06.078208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:47:06.078208 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:47:06.079801 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:47:06.079801 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:06.079801 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:47:06.079801 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:06.079801 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:47:06.079801 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:47:06.079801 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:47:06.079801 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: 7c4da21fbfa3472cac6e766a2f4799d8 Jul 01 16:47:06.079801 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:47:06.079801 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: > Jul 01 16:47:06.079801 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Instance d475a49d-1ee9-4cb0-aaea-507155a02204 could not be found. Jul 01 16:47:06.079801 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'id': 'd475a49d-1ee9-4cb0-aaea-507155a02204'} Jul 01 16:47:06.080728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:47:06.080728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:06.080728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:47:06.080728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:47:06.080728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:47:06.080728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:47:06.080728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:47:06.080728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:47:06.080728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:47:06.080728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:47:06.080728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d475a49d-1ee9-4cb0-aaea-507155a02204 could not be found. Jul 01 16:47:06.080728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:06.080728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:06.080728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:06.080728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:06.080728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:06.080728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:06.080728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:47:06.080728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:47:06.080728 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:47:06.083121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:47:06.083121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:47:06.083121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:47:06.083121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:47:06.083121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:47:06.083121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:47:06.083121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:47:06.083121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d475a49d-1ee9-4cb0-aaea-507155a02204 could not be found. Jul 01 16:47:06.083121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:06.083121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:06.083121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:06.083121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:06.083121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:06.083121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:06.083121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:47:06.083121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:47:06.083121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d475a49d-1ee9-4cb0-aaea-507155a02204 could not be found. Jul 01 16:47:06.083121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:06.084542 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9d428ffa-5bd5-4ab6-af41-ce46b70610dc tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Returning 404 to user: Instance d475a49d-1ee9-4cb0-aaea-507155a02204 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:47:06.084542 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9d428ffa-5bd5-4ab6-af41-ce46b70610dc tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204" status: 404 len: 111 microversion: 2.1 time: 0.028291 Jul 01 16:47:06.084542 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 412/825] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:06 2022] GET /compute/v2.1/servers/d475a49d-1ee9-4cb0-aaea-507155a02204 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:47:07.211792 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d131be89-f4d7-4d22-ad7a-7f7a55ba0887 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:07.212274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d131be89-f4d7-4d22-ad7a-7f7a55ba0887 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:07.218721 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d131be89-f4d7-4d22-ad7a-7f7a55ba0887 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:07.219164 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d131be89-f4d7-4d22-ad7a-7f7a55ba0887 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:07.219909 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d131be89-f4d7-4d22-ad7a-7f7a55ba0887 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:07.220340 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d131be89-f4d7-4d22-ad7a-7f7a55ba0887 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:07.234019 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-d131be89-f4d7-4d22-ad7a-7f7a55ba0887 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] HTTP exception thrown: Instance bdb792a6-440e-4a96-89d8-3b65ee1a5a2e could not be found. Jul 01 16:47:07.235585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d131be89-f4d7-4d22-ad7a-7f7a55ba0887 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Request method failure captured: Jul 01 16:47:07.235585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: DELETE /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e HTTP/1.1 Jul 01 16:47:07.235585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:47:07.235585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:47:07.235585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:47:07.235585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:47:07.235585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:47:07.235585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:47:07.235585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:47:07.235585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:47:07.235585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyN28kRS6gk46UU5wMmPqqrbKCAlsLmUAL51tGA7XZ2wRJWF2nXTu75kTgDFZ7hA4wbbjyjFuM6MIxqsPPN7wq3gn9HT9lV3kgc_ncS5tAqdDIsXq38bqSWgq9ddXJaghqMv_F2GaWnIjXUUxQMmZS8lrawCYahe-iQxu0RYfE47KKI Jul 01 16:47:07.235585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:47:07.235585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:47:07.235585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:47:07.235585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:47:07.235585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:47:07.235585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:47:07.235585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:47:07.235585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:07.235585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:47:07.235585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:47:07.237903 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:47:07.237903 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:07.237903 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:47:07.237903 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:07.237903 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:47:07.237903 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:47:07.237903 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:47:07.237903 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: 7c4da21fbfa3472cac6e766a2f4799d8 Jul 01 16:47:07.237903 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:47:07.237903 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:47:07.237903 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance bdb792a6-440e-4a96-89d8-3b65ee1a5a2e could not be found. Jul 01 16:47:07.237903 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': 'bdb792a6-440e-4a96-89d8-3b65ee1a5a2e'} Jul 01 16:47:07.239027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:47:07.239027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:07.239027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:47:07.239027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:47:07.239027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:47:07.239027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:47:07.239027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:47:07.239027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:47:07.239027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:47:07.239027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:47:07.239027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdb792a6-440e-4a96-89d8-3b65ee1a5a2e could not be found. Jul 01 16:47:07.239027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:07.239027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:07.239027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:07.239027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:07.239027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:07.239027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:07.239027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:47:07.239027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:47:07.239027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:47:07.240556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:47:07.240556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 16:47:07.240556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 16:47:07.240556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 16:47:07.240556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 16:47:07.240556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:47:07.240556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:47:07.240556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:47:07.240556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:47:07.240556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdb792a6-440e-4a96-89d8-3b65ee1a5a2e could not be found. Jul 01 16:47:07.240556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:07.240556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:07.240556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:07.240556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:07.240556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:07.240556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:07.240556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:47:07.240556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:47:07.240556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdb792a6-440e-4a96-89d8-3b65ee1a5a2e could not be found. Jul 01 16:47:07.240556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:07.241993 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d131be89-f4d7-4d22-ad7a-7f7a55ba0887 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Returning 404 to user: Instance bdb792a6-440e-4a96-89d8-3b65ee1a5a2e could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:47:07.241993 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d131be89-f4d7-4d22-ad7a-7f7a55ba0887 tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "DELETE /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 404 len: 111 microversion: 2.1 time: 0.029275 Jul 01 16:47:07.241993 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 414/826] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:47:07 2022] DELETE /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 16:47:07.245804 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-70103f46-0363-439d-9181-e22375cc751f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:07.246483 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-70103f46-0363-439d-9181-e22375cc751f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] [instance: bdb792a6-440e-4a96-89d8-3b65ee1a5a2e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:07.252598 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-70103f46-0363-439d-9181-e22375cc751f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:07.253649 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-70103f46-0363-439d-9181-e22375cc751f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:07.254453 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-70103f46-0363-439d-9181-e22375cc751f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:07.254887 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-70103f46-0363-439d-9181-e22375cc751f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:07.267786 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-70103f46-0363-439d-9181-e22375cc751f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] HTTP exception thrown: Instance bdb792a6-440e-4a96-89d8-3b65ee1a5a2e could not be found. Jul 01 16:47:07.270213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-70103f46-0363-439d-9181-e22375cc751f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Request method failure captured: Jul 01 16:47:07.270213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e HTTP/1.1 Jul 01 16:47:07.270213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:47:07.270213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:47:07.270213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:47:07.270213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:47:07.270213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:47:07.270213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:47:07.270213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:47:07.270213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:47:07.270213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyN28kRS6gk46UU5wMmPqqrbKCAlsLmUAL51tGA7XZ2wRJWF2nXTu75kTgDFZ7hA4wbbjyjFuM6MIxqsPPN7wq3gn9HT9lV3kgc_ncS5tAqdDIsXq38bqSWgq9ddXJaghqMv_F2GaWnIjXUUxQMmZS8lrawCYahe-iQxu0RYfE47KKI Jul 01 16:47:07.270213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:47:07.270213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:47:07.270213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:47:07.270213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:47:07.270213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:47:07.270213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:47:07.270213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:47:07.270213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:07.270213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:47:07.270213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:47:07.271840 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5747a83d930f4075a78e9b14abd58c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:47:07.271840 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:07.271840 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 5747a83d930f4075a78e9b14abd58c7f Jul 01 16:47:07.271840 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631009127 Jul 01 16:47:07.271840 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:47:07.271840 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:47:07.271840 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:47:07.271840 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: 7c4da21fbfa3472cac6e766a2f4799d8 Jul 01 16:47:07.271840 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeNegativeTest-631009127-project Jul 01 16:47:07.271840 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: > Jul 01 16:47:07.271840 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Instance bdb792a6-440e-4a96-89d8-3b65ee1a5a2e could not be found. Jul 01 16:47:07.271840 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'id': 'bdb792a6-440e-4a96-89d8-3b65ee1a5a2e'} Jul 01 16:47:07.272789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:47:07.272789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:07.272789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:47:07.272789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:47:07.272789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:47:07.272789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:47:07.272789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:47:07.272789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:47:07.272789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:47:07.272789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:47:07.272789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdb792a6-440e-4a96-89d8-3b65ee1a5a2e could not be found. Jul 01 16:47:07.272789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:07.272789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:07.272789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:07.272789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:07.272789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:07.272789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:07.272789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:47:07.272789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:47:07.272789 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:47:07.274230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:47:07.274230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:47:07.274230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:47:07.274230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:47:07.274230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:47:07.274230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:47:07.274230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:47:07.274230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdb792a6-440e-4a96-89d8-3b65ee1a5a2e could not be found. Jul 01 16:47:07.274230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:07.274230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:07.274230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:07.274230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:07.274230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:07.274230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:07.274230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:47:07.274230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:47:07.274230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdb792a6-440e-4a96-89d8-3b65ee1a5a2e could not be found. Jul 01 16:47:07.274230 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:07.275764 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-70103f46-0363-439d-9181-e22375cc751f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] Returning 404 to user: Instance bdb792a6-440e-4a96-89d8-3b65ee1a5a2e could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:47:07.275764 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-70103f46-0363-439d-9181-e22375cc751f tempest-AttachVolumeNegativeTest-631009127 tempest-AttachVolumeNegativeTest-631009127-project] 10.222.0.57 "GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e" status: 404 len: 111 microversion: 2.1 time: 0.029522 Jul 01 16:47:07.275764 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 413/827] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:07 2022] GET /compute/v2.1/servers/bdb792a6-440e-4a96-89d8-3b65ee1a5a2e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:47:11.745850 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-aeda9d8b-8c32-4a07-98e8-20f0f22f8abb tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] Action: 'create', calling method: .version_select at 0x7fa86c37fca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1952812839", "metadata": {"Type": "work"}}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:47:11.776403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-aeda9d8b-8c32-4a07-98e8-20f0f22f8abb tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] Request method failure captured: Jul 01 16:47:11.776403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 01 16:47:11.776403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:47:11.776403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:47:11.776403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:47:11.776403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 122 Jul 01 16:47:11.776403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:47:11.776403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:47:11.776403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:47:11.776403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:47:11.776403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyUPKHhqlvOKOMCBGvWlO7xytMDf6XrUYak5X7HCvrGSRURMblF2PhbKs8TRGRus4uhQBkAceBvJqh6FkxdRb6rcifcXIEmswqLZvosVczNXcxcTWqfxXxZ7wKY8eAPJbQUu0W1y0_ztfyroXxFH79FH7VfRvWxX-xWmUBHmjNAPXjQ Jul 01 16:47:11.776403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:47:11.776403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:47:11.776403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:47:11.776403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:47:11.776403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:47:11.776403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:47:11.776403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: db98a6214dec4c0c9cbca95c8788171f Jul 01 16:47:11.776403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-VolumesNegativeTest-757112346 Jul 01 16:47:11.776403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:47:11.776403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:47:11.778067 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:47:11.778067 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-VolumesNegativeTest-757112346 Jul 01 16:47:11.778067 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: db98a6214dec4c0c9cbca95c8788171f Jul 01 16:47:11.778067 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-VolumesNegativeTest-757112346 Jul 01 16:47:11.778067 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-VolumesNegativeTest-757112346-project Jul 01 16:47:11.778067 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:47:11.778067 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:47:11.778067 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: a4a4e810e8b240eb99f0b5faf77ece0e Jul 01 16:47:11.778067 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-VolumesNegativeTest-757112346-project Jul 01 16:47:11.778067 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Jul 01 16:47:11.778067 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1952812839", "metadata": {"Type": "work"}}} Jul 01 16:47:11.778067 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: Jul 01 16:47:11.778067 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 01 16:47:11.779044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1952812839', 'metadata': {'Type': 'work'}}}} Jul 01 16:47:11.779044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:47:11.779044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:11.779044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 16:47:11.779044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 16:47:11.779044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 16:47:11.779044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise error Jul 01 16:47:11.779044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 01 16:47:11.779044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.779044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 01 16:47:11.779044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 01 16:47:11.779044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.779044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 01 16:47:11.779044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi '#$%' Jul 01 16:47:11.779044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.779044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:11.779044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.779044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:11.779044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:11.779044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:11.779044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:47:11.779044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:47:11.780372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 16:47:11.780372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 16:47:11.780372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:47:11.780372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:47:11.780372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 16:47:11.780372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 16:47:11.780372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 16:47:11.780372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 16:47:11.780372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 16:47:11.780372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 16:47:11.780372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 01 16:47:11.780372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.780372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:11.780372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.780372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:11.780372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:11.780372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:11.780372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 16:47:11.780372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 16:47:11.781891 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 01 16:47:11.781891 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.781891 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-aeda9d8b-8c32-4a07-98e8-20f0f22f8abb tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:47:11.781891 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-aeda9d8b-8c32-4a07-98e8-20f0f22f8abb tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.157404 Jul 01 16:47:11.781891 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 415/828] 10.222.0.57 () {60 vars in 1155 bytes} [Fri Jul 1 16:47:11 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 16:47:11.787971 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-54772be0-65d0-412f-a360-80e34bb0d46e tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] Action: 'create', calling method: .version_select at 0x7fa85f232ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-412327334", "metadata": {"Type": "work"}}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:47:11.791148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-54772be0-65d0-412f-a360-80e34bb0d46e tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] Request method failure captured: Jul 01 16:47:11.791148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 01 16:47:11.791148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:47:11.791148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:47:11.791148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:47:11.791148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 119 Jul 01 16:47:11.791148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:47:11.791148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:47:11.791148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:47:11.791148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:47:11.791148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyUPKHhqlvOKOMCBGvWlO7xytMDf6XrUYak5X7HCvrGSRURMblF2PhbKs8TRGRus4uhQBkAceBvJqh6FkxdRb6rcifcXIEmswqLZvosVczNXcxcTWqfxXxZ7wKY8eAPJbQUu0W1y0_ztfyroXxFH79FH7VfRvWxX-xWmUBHmjNAPXjQ Jul 01 16:47:11.791148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:47:11.791148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:47:11.791148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:47:11.791148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:47:11.791148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:47:11.791148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:47:11.791148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: db98a6214dec4c0c9cbca95c8788171f Jul 01 16:47:11.791148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-VolumesNegativeTest-757112346 Jul 01 16:47:11.791148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:47:11.791148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:47:11.792703 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:47:11.792703 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-VolumesNegativeTest-757112346 Jul 01 16:47:11.792703 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: db98a6214dec4c0c9cbca95c8788171f Jul 01 16:47:11.792703 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-VolumesNegativeTest-757112346 Jul 01 16:47:11.792703 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-VolumesNegativeTest-757112346-project Jul 01 16:47:11.792703 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:47:11.792703 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:47:11.792703 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: a4a4e810e8b240eb99f0b5faf77ece0e Jul 01 16:47:11.792703 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-VolumesNegativeTest-757112346-project Jul 01 16:47:11.792703 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Jul 01 16:47:11.792703 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-412327334", "metadata": {"Type": "work"}}} Jul 01 16:47:11.792703 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: Jul 01 16:47:11.792703 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 01 16:47:11.793557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-412327334', 'metadata': {'Type': 'work'}}}} Jul 01 16:47:11.793557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:47:11.793557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:11.793557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 16:47:11.793557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 16:47:11.793557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 16:47:11.793557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise error Jul 01 16:47:11.793557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 01 16:47:11.793557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.793557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 01 16:47:11.793557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 01 16:47:11.793557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.793557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 01 16:47:11.793557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi '0' Jul 01 16:47:11.793557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.793557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:11.793557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.793557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:11.793557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:11.793557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:11.793557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:47:11.793557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:47:11.795004 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 16:47:11.795004 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 16:47:11.795004 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:47:11.795004 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:47:11.795004 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 16:47:11.795004 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 16:47:11.795004 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 16:47:11.795004 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 16:47:11.795004 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 16:47:11.795004 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 16:47:11.795004 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 01 16:47:11.795004 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.795004 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:11.795004 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.795004 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:11.795004 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:11.795004 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:11.795004 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 16:47:11.795004 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 16:47:11.796291 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 01 16:47:11.796291 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.796291 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-54772be0-65d0-412f-a360-80e34bb0d46e tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:47:11.796291 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-54772be0-65d0-412f-a360-80e34bb0d46e tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009009 Jul 01 16:47:11.796291 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 414/829] 10.222.0.57 () {60 vars in 1155 bytes} [Fri Jul 1 16:47:11 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 01 16:47:11.802956 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-796a82d8-3840-4d46-b86c-a97ce801eb1c tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] Action: 'create', calling method: .version_select at 0x7fa86c3fdd30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-304652588", "metadata": {"Type": "work"}}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:47:11.806152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-796a82d8-3840-4d46-b86c-a97ce801eb1c tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] Request method failure captured: Jul 01 16:47:11.806152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 01 16:47:11.806152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:47:11.806152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:47:11.806152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:47:11.806152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 118 Jul 01 16:47:11.806152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:47:11.806152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:47:11.806152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:47:11.806152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:47:11.806152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyUPKHhqlvOKOMCBGvWlO7xytMDf6XrUYak5X7HCvrGSRURMblF2PhbKs8TRGRus4uhQBkAceBvJqh6FkxdRb6rcifcXIEmswqLZvosVczNXcxcTWqfxXxZ7wKY8eAPJbQUu0W1y0_ztfyroXxFH79FH7VfRvWxX-xWmUBHmjNAPXjQ Jul 01 16:47:11.806152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:47:11.806152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:47:11.806152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:47:11.806152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:47:11.806152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:47:11.806152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:47:11.806152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: db98a6214dec4c0c9cbca95c8788171f Jul 01 16:47:11.806152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-VolumesNegativeTest-757112346 Jul 01 16:47:11.806152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:47:11.806152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:47:11.807788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:47:11.807788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-VolumesNegativeTest-757112346 Jul 01 16:47:11.807788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: db98a6214dec4c0c9cbca95c8788171f Jul 01 16:47:11.807788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-VolumesNegativeTest-757112346 Jul 01 16:47:11.807788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-VolumesNegativeTest-757112346-project Jul 01 16:47:11.807788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:47:11.807788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:47:11.807788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: a4a4e810e8b240eb99f0b5faf77ece0e Jul 01 16:47:11.807788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-VolumesNegativeTest-757112346-project Jul 01 16:47:11.807788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Jul 01 16:47:11.807788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-304652588", "metadata": {"Type": "work"}}} Jul 01 16:47:11.807788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: Jul 01 16:47:11.807788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 01 16:47:11.808747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-304652588', 'metadata': {'Type': 'work'}}}} Jul 01 16:47:11.808747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:47:11.808747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:11.808747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 16:47:11.808747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 16:47:11.808747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 16:47:11.808747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise error Jul 01 16:47:11.808747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 01 16:47:11.808747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.808747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 01 16:47:11.808747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 01 16:47:11.808747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.808747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 01 16:47:11.808747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi '' Jul 01 16:47:11.808747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.808747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:11.808747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.808747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:11.808747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:11.808747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:11.808747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:47:11.808747 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:47:11.810405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 16:47:11.810405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 16:47:11.810405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:47:11.810405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:47:11.810405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 16:47:11.810405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 16:47:11.810405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 16:47:11.810405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 16:47:11.810405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 16:47:11.810405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 16:47:11.810405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 01 16:47:11.810405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.810405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:11.810405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.810405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:11.810405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:11.810405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:11.810405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 16:47:11.810405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 16:47:11.812113 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 01 16:47:11.812113 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.812113 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-796a82d8-3840-4d46-b86c-a97ce801eb1c tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:47:11.812113 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-796a82d8-3840-4d46-b86c-a97ce801eb1c tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009516 Jul 01 16:47:11.812113 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 416/830] 10.222.0.57 () {60 vars in 1155 bytes} [Fri Jul 1 16:47:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 16:47:11.817691 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b2bba936-a213-4996-9153-8cd46c649f99 tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] Calling method '.version_select at 0x7fa85f1e1550>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:11.847661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-b2bba936-a213-4996-9153-8cd46c649f99 tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] HTTP exception thrown: Volume tempest-invalid-200212607 could not be found. Jul 01 16:47:11.849603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b2bba936-a213-4996-9153-8cd46c649f99 tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] Request method failure captured: Jul 01 16:47:11.849603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-200212607 HTTP/1.1 Jul 01 16:47:11.849603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:47:11.849603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:47:11.849603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:47:11.849603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:47:11.849603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:47:11.849603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:47:11.849603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:47:11.849603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:47:11.849603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyUPKHhqlvOKOMCBGvWlO7xytMDf6XrUYak5X7HCvrGSRURMblF2PhbKs8TRGRus4uhQBkAceBvJqh6FkxdRb6rcifcXIEmswqLZvosVczNXcxcTWqfxXxZ7wKY8eAPJbQUu0W1y0_ztfyroXxFH79FH7VfRvWxX-xWmUBHmjNAPXjQ Jul 01 16:47:11.849603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:47:11.849603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:47:11.849603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:47:11.849603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:47:11.849603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:47:11.849603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:47:11.849603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: db98a6214dec4c0c9cbca95c8788171f Jul 01 16:47:11.849603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-VolumesNegativeTest-757112346 Jul 01 16:47:11.849603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:47:11.849603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:47:11.851264 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:47:11.851264 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-VolumesNegativeTest-757112346 Jul 01 16:47:11.851264 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: db98a6214dec4c0c9cbca95c8788171f Jul 01 16:47:11.851264 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-VolumesNegativeTest-757112346 Jul 01 16:47:11.851264 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-VolumesNegativeTest-757112346-project Jul 01 16:47:11.851264 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:47:11.851264 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:47:11.851264 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: a4a4e810e8b240eb99f0b5faf77ece0e Jul 01 16:47:11.851264 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-VolumesNegativeTest-757112346-project Jul 01 16:47:11.851264 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: Jul 01 16:47:11.851264 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Volume tempest-invalid-200212607 could not be found. Jul 01 16:47:11.851264 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'id': 'tempest-invalid-200212607'} Jul 01 16:47:11.851264 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:47:11.852688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:11.852688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 16:47:11.852688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 16:47:11.852688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 16:47:11.852688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 16:47:11.852688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 16:47:11.852688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 16:47:11.852688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 16:47:11.852688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 16:47:11.852688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 16:47:11.852688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 16:47:11.852688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 16:47:11.852688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 16:47:11.852688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 16:47:11.852688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 16:47:11.852688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-200212607 could not be found. (HTTP 404) (Request-ID: req-84becfba-2944-4622-a358-0c12c4932eb2) Jul 01 16:47:11.852688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.852688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:11.852688 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.855414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:11.855414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 01 16:47:11.855414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 01 16:47:11.855414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 16:47:11.855414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 16:47:11.855414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 16:47:11.855414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 16:47:11.855414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 16:47:11.855414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 16:47:11.855414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 16:47:11.855414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 16:47:11.855414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 16:47:11.855414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 16:47:11.855414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 16:47:11.855414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 16:47:11.855414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 16:47:11.855414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 16:47:11.855414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 16:47:11.855414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 16:47:11.856825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 16:47:11.856825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 16:47:11.856825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 16:47:11.856825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 16:47:11.856825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-200212607 could not be found. Jul 01 16:47:11.856825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.856825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:11.856825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.856825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:11.856825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:11.856825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:11.856825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:47:11.856825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:47:11.856825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 16:47:11.856825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 16:47:11.856825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:47:11.856825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:47:11.856825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 01 16:47:11.856825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:47:11.856825 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-200212607 could not be found. Jul 01 16:47:11.858279 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.858279 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:11.858279 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.858279 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:11.858279 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:11.858279 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:11.858279 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:47:11.858279 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:47:11.858279 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-200212607 could not be found. Jul 01 16:47:11.858279 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.858279 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b2bba936-a213-4996-9153-8cd46c649f99 tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] Returning 404 to user: Volume tempest-invalid-200212607 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:47:11.858279 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b2bba936-a213-4996-9153-8cd46c649f99 tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-200212607" status: 404 len: 98 microversion: 2.1 time: 0.038222 Jul 01 16:47:11.858279 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 415/831] 10.222.0.57 () {58 vars in 1214 bytes} [Fri Jul 1 16:47:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-200212607 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 16:47:11.860208 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-59dd950e-63f6-425c-ab69-e58e1ef3eb44 tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003669 Jul 01 16:47:11.860695 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 417/832] 10.222.0.57 () {58 vars in 1139 bytes} [Fri Jul 1 16:47:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 01 16:47:11.869002 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d4f36a9a-9db0-4b40-9900-bece201ecfc1 tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003772 Jul 01 16:47:11.869426 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 416/833] 10.222.0.57 () {58 vars in 1136 bytes} [Fri Jul 1 16:47:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 01 16:47:11.878560 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6f75f00b-3bb1-42dd-b162-e7d0765437d6 tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] Calling method '.version_select at 0x7fa86c37f550>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:11.905927 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-6f75f00b-3bb1-42dd-b162-e7d0765437d6 tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] HTTP exception thrown: Volume a7ca7782-cb64-467c-a1ef-009467762021 could not be found. Jul 01 16:47:11.907904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6f75f00b-3bb1-42dd-b162-e7d0765437d6 tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] Request method failure captured: Jul 01 16:47:11.907904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: DELETE /compute/v2.1/os-volumes/a7ca7782-cb64-467c-a1ef-009467762021 HTTP/1.1 Jul 01 16:47:11.907904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:47:11.907904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:47:11.907904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:47:11.907904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:47:11.907904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:47:11.907904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:47:11.907904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:47:11.907904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:47:11.907904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyUPKHhqlvOKOMCBGvWlO7xytMDf6XrUYak5X7HCvrGSRURMblF2PhbKs8TRGRus4uhQBkAceBvJqh6FkxdRb6rcifcXIEmswqLZvosVczNXcxcTWqfxXxZ7wKY8eAPJbQUu0W1y0_ztfyroXxFH79FH7VfRvWxX-xWmUBHmjNAPXjQ Jul 01 16:47:11.907904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:47:11.907904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:47:11.907904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:47:11.907904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:47:11.907904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:47:11.907904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:47:11.907904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: db98a6214dec4c0c9cbca95c8788171f Jul 01 16:47:11.907904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-VolumesNegativeTest-757112346 Jul 01 16:47:11.907904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:47:11.907904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:47:11.910563 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:47:11.910563 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-VolumesNegativeTest-757112346 Jul 01 16:47:11.910563 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: db98a6214dec4c0c9cbca95c8788171f Jul 01 16:47:11.910563 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-VolumesNegativeTest-757112346 Jul 01 16:47:11.910563 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-VolumesNegativeTest-757112346-project Jul 01 16:47:11.910563 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:47:11.910563 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:47:11.910563 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: a4a4e810e8b240eb99f0b5faf77ece0e Jul 01 16:47:11.910563 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-VolumesNegativeTest-757112346-project Jul 01 16:47:11.910563 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: Jul 01 16:47:11.910563 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Volume a7ca7782-cb64-467c-a1ef-009467762021 could not be found. Jul 01 16:47:11.910563 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': 'a7ca7782-cb64-467c-a1ef-009467762021'} Jul 01 16:47:11.910563 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:47:11.911549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:11.911549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 16:47:11.911549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 16:47:11.911549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 16:47:11.911549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 16:47:11.911549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 16:47:11.911549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 16:47:11.911549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 16:47:11.911549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 16:47:11.911549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 16:47:11.911549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 16:47:11.911549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 16:47:11.911549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 16:47:11.911549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 16:47:11.911549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 16:47:11.911549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a7ca7782-cb64-467c-a1ef-009467762021 could not be found. (HTTP 404) (Request-ID: req-2c870477-212a-498f-aeda-90a90f39a354) Jul 01 16:47:11.911549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.911549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:11.911549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.913029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:11.913029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 01 16:47:11.913029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 01 16:47:11.913029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 16:47:11.913029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 16:47:11.913029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 16:47:11.913029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 16:47:11.913029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 16:47:11.913029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 16:47:11.913029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 16:47:11.913029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 16:47:11.913029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 16:47:11.913029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 16:47:11.913029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 16:47:11.913029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 16:47:11.913029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 16:47:11.913029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 16:47:11.913029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 16:47:11.913029 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 16:47:11.914277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 16:47:11.914277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 16:47:11.914277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 16:47:11.914277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 16:47:11.914277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a7ca7782-cb64-467c-a1ef-009467762021 could not be found. Jul 01 16:47:11.914277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.914277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:11.914277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.914277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:11.914277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:11.914277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:11.914277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:47:11.914277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:47:11.914277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 16:47:11.914277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 16:47:11.914277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:47:11.914277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:47:11.914277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 01 16:47:11.914277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:47:11.915737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a7ca7782-cb64-467c-a1ef-009467762021 could not be found. Jul 01 16:47:11.915737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.915737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:11.915737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.915737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:11.915737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:11.915737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:11.915737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:47:11.915737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:47:11.915737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a7ca7782-cb64-467c-a1ef-009467762021 could not be found. Jul 01 16:47:11.915737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.915737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6f75f00b-3bb1-42dd-b162-e7d0765437d6 tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] Returning 404 to user: Volume a7ca7782-cb64-467c-a1ef-009467762021 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:47:11.915737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6f75f00b-3bb1-42dd-b162-e7d0765437d6 tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/a7ca7782-cb64-467c-a1ef-009467762021" status: 404 len: 109 microversion: 2.1 time: 0.035949 Jul 01 16:47:11.915737 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 418/834] 10.222.0.57 () {58 vars in 1247 bytes} [Fri Jul 1 16:47:11 2022] DELETE /compute/v2.1/os-volumes/a7ca7782-cb64-467c-a1ef-009467762021 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:47:11.920469 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cc1a262a-e819-4703-9b16-d77d680b2bb7 tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] Calling method '.version_select at 0x7fa85f40aa60>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:11.947049 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-cc1a262a-e819-4703-9b16-d77d680b2bb7 tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] HTTP exception thrown: Volume d44fc6bc-1d0f-4eab-8102-998d2f4f1fef could not be found. Jul 01 16:47:11.949021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cc1a262a-e819-4703-9b16-d77d680b2bb7 tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] Request method failure captured: Jul 01 16:47:11.949021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/os-volumes/d44fc6bc-1d0f-4eab-8102-998d2f4f1fef HTTP/1.1 Jul 01 16:47:11.949021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:47:11.949021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:47:11.949021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:47:11.949021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:47:11.949021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:47:11.949021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:47:11.949021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:47:11.949021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:47:11.949021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyUPKHhqlvOKOMCBGvWlO7xytMDf6XrUYak5X7HCvrGSRURMblF2PhbKs8TRGRus4uhQBkAceBvJqh6FkxdRb6rcifcXIEmswqLZvosVczNXcxcTWqfxXxZ7wKY8eAPJbQUu0W1y0_ztfyroXxFH79FH7VfRvWxX-xWmUBHmjNAPXjQ Jul 01 16:47:11.949021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:47:11.949021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:47:11.949021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:47:11.949021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:47:11.949021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:47:11.949021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:47:11.949021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: db98a6214dec4c0c9cbca95c8788171f Jul 01 16:47:11.949021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-VolumesNegativeTest-757112346 Jul 01 16:47:11.949021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:47:11.949021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:47:11.950636 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/db98a6214dec4c0c9cbca95c8788171f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:47:11.950636 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-VolumesNegativeTest-757112346 Jul 01 16:47:11.950636 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: db98a6214dec4c0c9cbca95c8788171f Jul 01 16:47:11.950636 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-VolumesNegativeTest-757112346 Jul 01 16:47:11.950636 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-VolumesNegativeTest-757112346-project Jul 01 16:47:11.950636 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:47:11.950636 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:47:11.950636 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: a4a4e810e8b240eb99f0b5faf77ece0e Jul 01 16:47:11.950636 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-VolumesNegativeTest-757112346-project Jul 01 16:47:11.950636 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: Jul 01 16:47:11.950636 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Volume d44fc6bc-1d0f-4eab-8102-998d2f4f1fef could not be found. Jul 01 16:47:11.950636 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'id': 'd44fc6bc-1d0f-4eab-8102-998d2f4f1fef'} Jul 01 16:47:11.950636 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:47:11.952313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:11.952313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 16:47:11.952313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 16:47:11.952313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 16:47:11.952313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 16:47:11.952313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 16:47:11.952313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 16:47:11.952313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 16:47:11.952313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 16:47:11.952313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 16:47:11.952313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 16:47:11.952313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 16:47:11.952313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 16:47:11.952313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 16:47:11.952313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 16:47:11.952313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d44fc6bc-1d0f-4eab-8102-998d2f4f1fef could not be found. (HTTP 404) (Request-ID: req-e305dce0-0340-47b4-8133-00b015e1ed00) Jul 01 16:47:11.952313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.952313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:11.952313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.953663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:11.953663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 16:47:11.953663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 16:47:11.953663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 16:47:11.953663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 16:47:11.953663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 16:47:11.953663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 16:47:11.953663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 16:47:11.953663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 16:47:11.953663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 16:47:11.953663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 16:47:11.953663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 16:47:11.953663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 16:47:11.953663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 16:47:11.953663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 16:47:11.953663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 16:47:11.953663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 16:47:11.953663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 16:47:11.953663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 16:47:11.954977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 16:47:11.954977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 16:47:11.954977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 16:47:11.954977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 16:47:11.954977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d44fc6bc-1d0f-4eab-8102-998d2f4f1fef could not be found. Jul 01 16:47:11.954977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.954977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:11.954977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.954977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:11.954977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:11.954977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:11.954977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:47:11.954977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:47:11.954977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 16:47:11.954977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 16:47:11.954977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:47:11.954977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:47:11.954977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 16:47:11.954977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:47:11.956929 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d44fc6bc-1d0f-4eab-8102-998d2f4f1fef could not be found. Jul 01 16:47:11.956929 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.956929 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:11.956929 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.956929 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:11.956929 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:11.956929 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:11.956929 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:47:11.956929 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:47:11.956929 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d44fc6bc-1d0f-4eab-8102-998d2f4f1fef could not be found. Jul 01 16:47:11.956929 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:11.956929 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cc1a262a-e819-4703-9b16-d77d680b2bb7 tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] Returning 404 to user: Volume d44fc6bc-1d0f-4eab-8102-998d2f4f1fef could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:47:11.956929 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-cc1a262a-e819-4703-9b16-d77d680b2bb7 tempest-VolumesNegativeTest-757112346 tempest-VolumesNegativeTest-757112346-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/d44fc6bc-1d0f-4eab-8102-998d2f4f1fef" status: 404 len: 109 microversion: 2.1 time: 0.033834 Jul 01 16:47:11.956929 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 417/835] 10.222.0.57 () {58 vars in 1244 bytes} [Fri Jul 1 16:47:11 2022] GET /compute/v2.1/os-volumes/d44fc6bc-1d0f-4eab-8102-998d2f4f1fef => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:47:26.408947 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=65 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:47:26.409739 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=14 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:47:26.414370 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-46f943a7-fa6e-4dbc-ac57-96906e74864f tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:26.414861 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-46f943a7-fa6e-4dbc-ac57-96906e74864f tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:26.421718 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-46f943a7-fa6e-4dbc-ac57-96906e74864f tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:26.422177 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-46f943a7-fa6e-4dbc-ac57-96906e74864f tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:26.422965 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-46f943a7-fa6e-4dbc-ac57-96906e74864f tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:26.423404 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-46f943a7-fa6e-4dbc-ac57-96906e74864f tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:26.449911 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-46f943a7-fa6e-4dbc-ac57-96906e74864f tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Going to try to terminate instance {{(pid=124317) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 16:47:26.527152 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-46f943a7-fa6e-4dbc-ac57-96906e74864f tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "DELETE /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 204 len: 0 microversion: 2.1 time: 0.119277 Jul 01 16:47:26.527902 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 419/836] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:47:26 2022] DELETE /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 16:47:26.535028 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:47:26.535809 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:47:26.540896 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-490f6e0d-3166-4fa1-bedd-defbf9d73147 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:26.541562 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-490f6e0d-3166-4fa1-bedd-defbf9d73147 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:26.551967 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-490f6e0d-3166-4fa1-bedd-defbf9d73147 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:26.552417 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-490f6e0d-3166-4fa1-bedd-defbf9d73147 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:26.553192 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-490f6e0d-3166-4fa1-bedd-defbf9d73147 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:26.553627 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-490f6e0d-3166-4fa1-bedd-defbf9d73147 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:26.707271 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-490f6e0d-3166-4fa1-bedd-defbf9d73147 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:26.716130 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-490f6e0d-3166-4fa1-bedd-defbf9d73147 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 200 len: 1577 microversion: 2.1 time: 0.183794 Jul 01 16:47:26.716684 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 418/837] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:26 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:27.733827 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1ac44436-445f-4201-80a0-14e01c5aed1a tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:27.734766 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1ac44436-445f-4201-80a0-14e01c5aed1a tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:27.741393 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1ac44436-445f-4201-80a0-14e01c5aed1a tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:27.741841 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1ac44436-445f-4201-80a0-14e01c5aed1a tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:27.742627 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1ac44436-445f-4201-80a0-14e01c5aed1a tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:27.743060 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1ac44436-445f-4201-80a0-14e01c5aed1a tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:27.932055 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1ac44436-445f-4201-80a0-14e01c5aed1a tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:27.940321 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1ac44436-445f-4201-80a0-14e01c5aed1a tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 200 len: 1577 microversion: 2.1 time: 0.210004 Jul 01 16:47:27.941008 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 420/838] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:27 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 1577 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:28.960044 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1d3e9862-a305-451e-adea-d9cd78b68e7c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:28.962408 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1d3e9862-a305-451e-adea-d9cd78b68e7c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:28.972713 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1d3e9862-a305-451e-adea-d9cd78b68e7c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:28.973231 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1d3e9862-a305-451e-adea-d9cd78b68e7c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:28.974132 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1d3e9862-a305-451e-adea-d9cd78b68e7c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:28.974711 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1d3e9862-a305-451e-adea-d9cd78b68e7c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:29.144377 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-1d3e9862-a305-451e-adea-d9cd78b68e7c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:29.152910 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1d3e9862-a305-451e-adea-d9cd78b68e7c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 200 len: 1577 microversion: 2.1 time: 0.199697 Jul 01 16:47:29.159926 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 419/839] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:28 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 1577 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:29.653466 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-6b18fedd-bd3d-4b46-b47f-c6abda9e0d1f req-f8d533ce-68a9-4f10-b4c6-d7f0b1b7e9cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33ee3ade-fd90-45c3-aa1c-d204a509deae", "name": "network-vif-deleted", "tag": "7fb3f553-408e-4f22-af02-9d3d0efa9d93"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:47:29.668364 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-6b18fedd-bd3d-4b46-b47f-c6abda9e0d1f req-f8d533ce-68a9-4f10-b4c6-d7f0b1b7e9cf service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:29.668811 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-6b18fedd-bd3d-4b46-b47f-c6abda9e0d1f req-f8d533ce-68a9-4f10-b4c6-d7f0b1b7e9cf service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:29.683019 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-6b18fedd-bd3d-4b46-b47f-c6abda9e0d1f req-f8d533ce-68a9-4f10-b4c6-d7f0b1b7e9cf service nova] Creating event network-vif-deleted:7fb3f553-408e-4f22-af02-9d3d0efa9d93 for instance 33ee3ade-fd90-45c3-aa1c-d204a509deae on hv-cinder-79760 Jul 01 16:47:29.688430 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-6b18fedd-bd3d-4b46-b47f-c6abda9e0d1f req-f8d533ce-68a9-4f10-b4c6-d7f0b1b7e9cf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038472 Jul 01 16:47:29.689812 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 421/840] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:47:30.170449 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b1f36bbd-0103-49c9-b620-fec5938d0975 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:30.171203 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b1f36bbd-0103-49c9-b620-fec5938d0975 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:30.178507 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b1f36bbd-0103-49c9-b620-fec5938d0975 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:30.178716 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b1f36bbd-0103-49c9-b620-fec5938d0975 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:30.179477 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b1f36bbd-0103-49c9-b620-fec5938d0975 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:30.180092 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b1f36bbd-0103-49c9-b620-fec5938d0975 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:30.213838 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b1f36bbd-0103-49c9-b620-fec5938d0975 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:30.214329 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b1f36bbd-0103-49c9-b620-fec5938d0975 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:30.214802 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-b1f36bbd-0103-49c9-b620-fec5938d0975 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lazy-loading 'fault' on Instance uuid 33ee3ade-fd90-45c3-aa1c-d204a509deae {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:47:30.266043 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b1f36bbd-0103-49c9-b620-fec5938d0975 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:30.276698 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b1f36bbd-0103-49c9-b620-fec5938d0975 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 200 len: 1230 microversion: 2.1 time: 0.110358 Jul 01 16:47:30.277485 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 420/841] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:30 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 1230 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:31.295378 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ac34e034-672c-4f52-ab83-18fabce2b65b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:31.296083 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ac34e034-672c-4f52-ab83-18fabce2b65b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:31.305254 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ac34e034-672c-4f52-ab83-18fabce2b65b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:31.305740 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ac34e034-672c-4f52-ab83-18fabce2b65b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:31.306557 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ac34e034-672c-4f52-ab83-18fabce2b65b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:31.306989 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ac34e034-672c-4f52-ab83-18fabce2b65b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:31.321235 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-ac34e034-672c-4f52-ab83-18fabce2b65b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] HTTP exception thrown: Instance 33ee3ade-fd90-45c3-aa1c-d204a509deae could not be found. Jul 01 16:47:31.322888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ac34e034-672c-4f52-ab83-18fabce2b65b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Request method failure captured: Jul 01 16:47:31.322888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae HTTP/1.1 Jul 01 16:47:31.322888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:47:31.322888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:47:31.322888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:47:31.322888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:47:31.322888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:47:31.322888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:47:31.322888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:47:31.322888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:47:31.322888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyR2f7LALLfskMHzaraFmTet8fc6f3bA_U7WB7hc6U08q8CvC6xG4MIs1HcRGKmZCbM0QSAKhLe3aT4Bhe6Br51vmkqnjbura-I2XEvTxze7G4otey9C2tKS0ML0IGXXFV9qJ8wNGpPlMfyAOc3q27lFGOTRDGwsGh_8oeqn3mAGZwY Jul 01 16:47:31.322888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:47:31.322888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:47:31.322888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:47:31.322888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:47:31.322888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:47:31.322888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:47:31.322888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: 0076c4e65bce4bd58478d09d62607981 Jul 01 16:47:31.322888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-TestVolumeBootPattern-262431778 Jul 01 16:47:31.322888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:47:31.322888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:47:31.324602 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0076c4e65bce4bd58478d09d62607981"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0076c4e65bce4bd58478d09d62607981"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0076c4e65bce4bd58478d09d62607981"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0076c4e65bce4bd58478d09d62607981"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:47:31.324602 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-TestVolumeBootPattern-262431778 Jul 01 16:47:31.324602 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 0076c4e65bce4bd58478d09d62607981 Jul 01 16:47:31.324602 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-TestVolumeBootPattern-262431778 Jul 01 16:47:31.324602 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-TestVolumeBootPattern-262431778-project Jul 01 16:47:31.324602 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:47:31.324602 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:47:31.324602 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: d6589e2636dd46838a3a0c66d18e0d00 Jul 01 16:47:31.324602 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-TestVolumeBootPattern-262431778-project Jul 01 16:47:31.324602 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:47:31.324602 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance 33ee3ade-fd90-45c3-aa1c-d204a509deae could not be found. Jul 01 16:47:31.324602 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': '33ee3ade-fd90-45c3-aa1c-d204a509deae'} Jul 01 16:47:31.325545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:47:31.325545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:31.325545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:47:31.325545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:47:31.325545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:47:31.325545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:47:31.325545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:47:31.325545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:47:31.325545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:47:31.325545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:47:31.325545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33ee3ade-fd90-45c3-aa1c-d204a509deae could not be found. Jul 01 16:47:31.325545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:31.325545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:31.325545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:31.325545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:31.325545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:31.325545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:31.325545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:47:31.325545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:47:31.325545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:47:31.327235 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:47:31.327235 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:47:31.327235 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:47:31.327235 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:47:31.327235 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:47:31.327235 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:47:31.327235 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:47:31.327235 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33ee3ade-fd90-45c3-aa1c-d204a509deae could not be found. Jul 01 16:47:31.327235 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:31.327235 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:31.327235 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:31.327235 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:31.327235 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:31.327235 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:31.327235 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:47:31.327235 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:47:31.327235 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33ee3ade-fd90-45c3-aa1c-d204a509deae could not be found. Jul 01 16:47:31.327235 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:31.328609 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ac34e034-672c-4f52-ab83-18fabce2b65b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Returning 404 to user: Instance 33ee3ade-fd90-45c3-aa1c-d204a509deae could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:47:31.328609 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ac34e034-672c-4f52-ab83-18fabce2b65b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 404 len: 111 microversion: 2.1 time: 0.033644 Jul 01 16:47:31.328609 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 422/842] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:31 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:47:31.423443 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d9fea264-16a5-49c4-869b-962a16801e9b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1120732739", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-611014614", "security_groups": [{"name": "tempest-secgroup-smoke-1604816131"}], "block_device_mapping_v2": [{"uuid": "b5fdd553-03a2-4d3a-aa22-5754153aa64e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6911cac0-9310-49e0-9165-12c7216cb763"}]}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:47:31.535229 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-d9fea264-16a5-49c4-869b-962a16801e9b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] validate_networks() for [('6911cac0-9310-49e0-9165-12c7216cb763', None, None, None, None, None)] {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 16:47:31.718937 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-56827b8f-81be-4e90-b7aa-7949b0f75f71 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:31.720272 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-56827b8f-81be-4e90-b7aa-7949b0f75f71 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:31.727156 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-56827b8f-81be-4e90-b7aa-7949b0f75f71 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:31.727601 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-56827b8f-81be-4e90-b7aa-7949b0f75f71 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:31.728366 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-56827b8f-81be-4e90-b7aa-7949b0f75f71 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:31.728800 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-56827b8f-81be-4e90-b7aa-7949b0f75f71 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:31.760812 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-56827b8f-81be-4e90-b7aa-7949b0f75f71 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045694 Jul 01 16:47:31.761396 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 423/843] 10.222.0.57 () {60 vars in 1342 bytes} [Fri Jul 1 16:47:31 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:47:31.822409 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-860d14c5-fab4-4d04-8600-ce420f69f4c0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:31.822900 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-860d14c5-fab4-4d04-8600-ce420f69f4c0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:31.829028 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-860d14c5-fab4-4d04-8600-ce420f69f4c0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:31.829469 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-860d14c5-fab4-4d04-8600-ce420f69f4c0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:31.831101 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-860d14c5-fab4-4d04-8600-ce420f69f4c0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:31.831526 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-860d14c5-fab4-4d04-8600-ce420f69f4c0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:31.858298 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-860d14c5-fab4-4d04-8600-ce420f69f4c0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Going to try to terminate instance {{(pid=124317) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 16:47:31.943764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-860d14c5-fab4-4d04-8600-ce420f69f4c0 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 204 len: 0 microversion: 2.20 time: 0.124926 Jul 01 16:47:31.944691 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 424/844] 10.222.0.57 () {60 vars in 1279 bytes} [Fri Jul 1 16:47:31 2022] DELETE /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 01 16:47:31.953077 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e9027609-b74c-4496-8450-60f891ab6fbc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:31.953768 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e9027609-b74c-4496-8450-60f891ab6fbc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:31.961233 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e9027609-b74c-4496-8450-60f891ab6fbc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:31.961680 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e9027609-b74c-4496-8450-60f891ab6fbc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:31.962470 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e9027609-b74c-4496-8450-60f891ab6fbc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:31.962905 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e9027609-b74c-4496-8450-60f891ab6fbc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:32.078461 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-d9fea264-16a5-49c4-869b-962a16801e9b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 16:47:32.078889 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-d9fea264-16a5-49c4-869b-962a16801e9b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 16:47:32.079624 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-d9fea264-16a5-49c4-869b-962a16801e9b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 16:47:32.081682 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-d9fea264-16a5-49c4-869b-962a16801e9b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 16:47:32.082106 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-d9fea264-16a5-49c4-869b-962a16801e9b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 16:47:32.092544 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d9fea264-16a5-49c4-869b-962a16801e9b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:32.093154 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d9fea264-16a5-49c4-869b-962a16801e9b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:32.093961 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d9fea264-16a5-49c4-869b-962a16801e9b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:32.094451 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d9fea264-16a5-49c4-869b-962a16801e9b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:32.114573 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-d9fea264-16a5-49c4-869b-962a16801e9b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Getting quotas for project 0076c4e65bce4bd58478d09d62607981. Resources: {'ram', 'cores', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:47:32.118624 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-d9fea264-16a5-49c4-869b-962a16801e9b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Getting quotas for user d6589e2636dd46838a3a0c66d18e0d00 and project 0076c4e65bce4bd58478d09d62607981. Resources: {'ram', 'cores', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:47:32.133801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e9027609-b74c-4496-8450-60f891ab6fbc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:32.148896 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e9027609-b74c-4496-8450-60f891ab6fbc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:32.150442 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e9027609-b74c-4496-8450-60f891ab6fbc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:32.151611 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e9027609-b74c-4496-8450-60f891ab6fbc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1723 microversion: 2.20 time: 0.202700 Jul 01 16:47:32.152159 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 425/845] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:47:31 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 16:47:32.191323 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d9fea264-16a5-49c4-869b-962a16801e9b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 16:47:32.193432 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d9fea264-16a5-49c4-869b-962a16801e9b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b5fdd553-03a2-4d3a-aa22-5754153aa64e',volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 16:47:32.331619 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d9fea264-16a5-49c4-869b-962a16801e9b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.911676 Jul 01 16:47:32.337560 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 421/846] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 1 16:47:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 16:47:32.343196 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-88b1847c-e112-4cb3-95f5-9ec8a37e6244 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:32.344251 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-88b1847c-e112-4cb3-95f5-9ec8a37e6244 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:32.405682 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-88b1847c-e112-4cb3-95f5-9ec8a37e6244 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:32.413333 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-88b1847c-e112-4cb3-95f5-9ec8a37e6244 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e" status: 200 len: 1094 microversion: 2.1 time: 0.073696 Jul 01 16:47:32.414405 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 426/847] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:32 2022] GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:33.170252 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-38ab198f-bcef-4687-b8ea-6d00122952f3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:33.170894 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-38ab198f-bcef-4687-b8ea-6d00122952f3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:33.179273 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-38ab198f-bcef-4687-b8ea-6d00122952f3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:33.179721 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-38ab198f-bcef-4687-b8ea-6d00122952f3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:33.180484 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-38ab198f-bcef-4687-b8ea-6d00122952f3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:33.180918 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-38ab198f-bcef-4687-b8ea-6d00122952f3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:33.318059 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-38ab198f-bcef-4687-b8ea-6d00122952f3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:33.325991 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-38ab198f-bcef-4687-b8ea-6d00122952f3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:33.327531 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-38ab198f-bcef-4687-b8ea-6d00122952f3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:33.328687 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-38ab198f-bcef-4687-b8ea-6d00122952f3 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1723 microversion: 2.20 time: 0.162454 Jul 01 16:47:33.329243 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 422/848] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:47:33 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:47:33.431423 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-22b3a192-829c-4737-bddd-f33aacc3d7b1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:33.432026 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-22b3a192-829c-4737-bddd-f33aacc3d7b1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:33.445046 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-22b3a192-829c-4737-bddd-f33aacc3d7b1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:33.445813 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-22b3a192-829c-4737-bddd-f33aacc3d7b1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:33.446787 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-22b3a192-829c-4737-bddd-f33aacc3d7b1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:33.447218 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-22b3a192-829c-4737-bddd-f33aacc3d7b1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:33.519585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-22b3a192-829c-4737-bddd-f33aacc3d7b1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:33.527364 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-22b3a192-829c-4737-bddd-f33aacc3d7b1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e" status: 200 len: 1136 microversion: 2.1 time: 0.099690 Jul 01 16:47:33.528308 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 427/849] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:33 2022] GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e => generated 1136 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:34.349089 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-53bad054-7652-451b-8217-5a6125d54758 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:34.349707 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-53bad054-7652-451b-8217-5a6125d54758 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:34.356452 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-53bad054-7652-451b-8217-5a6125d54758 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:34.356905 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-53bad054-7652-451b-8217-5a6125d54758 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:34.357683 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-53bad054-7652-451b-8217-5a6125d54758 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:34.358122 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-53bad054-7652-451b-8217-5a6125d54758 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:34.432802 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-53bad054-7652-451b-8217-5a6125d54758 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:34.441901 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-53bad054-7652-451b-8217-5a6125d54758 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:34.443455 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-53bad054-7652-451b-8217-5a6125d54758 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e471b31763074167ba81c2c25f39b857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315dd9cfab134d008039e1229e42a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:34.444785 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-53bad054-7652-451b-8217-5a6125d54758 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 200 len: 1656 microversion: 2.20 time: 0.100285 Jul 01 16:47:34.445573 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 423/850] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:47:34 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 1656 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 16:47:34.537584 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-babd867c-74eb-4117-91bc-a9364ceff4c0 req-e4b8643c-0d16-4e86-b725-7856ae3446ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d5cf19-9bb2-4534-8076-564fb7538cad", "name": "network-vif-deleted", "tag": "ca06c719-80eb-4c4d-b8cd-b06d9b34ab88"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:47:34.546366 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4b7b5a16-21b9-47b6-a8a2-c52e0902d4df tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:34.546986 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4b7b5a16-21b9-47b6-a8a2-c52e0902d4df tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:34.560519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4b7b5a16-21b9-47b6-a8a2-c52e0902d4df tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:34.560966 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4b7b5a16-21b9-47b6-a8a2-c52e0902d4df tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:34.561743 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4b7b5a16-21b9-47b6-a8a2-c52e0902d4df tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:34.562458 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4b7b5a16-21b9-47b6-a8a2-c52e0902d4df tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:34.570658 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-babd867c-74eb-4117-91bc-a9364ceff4c0 req-e4b8643c-0d16-4e86-b725-7856ae3446ca service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:34.571383 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-babd867c-74eb-4117-91bc-a9364ceff4c0 req-e4b8643c-0d16-4e86-b725-7856ae3446ca service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:34.589726 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-babd867c-74eb-4117-91bc-a9364ceff4c0 req-e4b8643c-0d16-4e86-b725-7856ae3446ca service nova] Creating event network-vif-deleted:ca06c719-80eb-4c4d-b8cd-b06d9b34ab88 for instance d8d5cf19-9bb2-4534-8076-564fb7538cad on hv-cinder-79760 Jul 01 16:47:34.599452 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-babd867c-74eb-4117-91bc-a9364ceff4c0 req-e4b8643c-0d16-4e86-b725-7856ae3446ca service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065832 Jul 01 16:47:34.600326 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 428/851] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:47:34.815098 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4b7b5a16-21b9-47b6-a8a2-c52e0902d4df tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:34.828626 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4b7b5a16-21b9-47b6-a8a2-c52e0902d4df tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e" status: 200 len: 1210 microversion: 2.1 time: 0.287604 Jul 01 16:47:34.829255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 424/852] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:34 2022] GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e => generated 1210 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:35.464843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-61874781-4207-49d9-8479-97bd59b91768 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:35.465966 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-61874781-4207-49d9-8479-97bd59b91768 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:35.474079 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-61874781-4207-49d9-8479-97bd59b91768 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:35.475101 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-61874781-4207-49d9-8479-97bd59b91768 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:35.476188 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-61874781-4207-49d9-8479-97bd59b91768 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:35.476796 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-61874781-4207-49d9-8479-97bd59b91768 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:35.492892 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-61874781-4207-49d9-8479-97bd59b91768 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] HTTP exception thrown: Instance d8d5cf19-9bb2-4534-8076-564fb7538cad could not be found. Jul 01 16:47:35.495047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-61874781-4207-49d9-8479-97bd59b91768 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Request method failure captured: Jul 01 16:47:35.495047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad HTTP/1.1 Jul 01 16:47:35.495047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:47:35.495047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:47:35.495047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:47:35.495047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:47:35.495047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:47:35.495047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:47:35.495047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:47:35.495047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:47:35.495047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyOEX7ZmlTowDJwBQle8fYRN6IIl6cTBoh3cWOEW-kmdqj74LprtFmwsfqVRVjL-Wk63ndafCHfHFjx80r_bi-PQhBVTV7Gpu8Kd94vqCVQXw25-3mUMpJW2YxXzdceSiVS31Af7uO0Trb3QuorNPILu2OHvdPrBv3nnbYzAn2_m4b0 Jul 01 16:47:35.495047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:47:35.495047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:47:35.495047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:47:35.495047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:47:35.495047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 16:47:35.495047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:47:35.495047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:47:35.495047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: 315dd9cfab134d008039e1229e42a96e Jul 01 16:47:35.495047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-23441539 Jul 01 16:47:35.495047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:47:35.495047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:47:35.496781 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/315dd9cfab134d008039e1229e42a96e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/315dd9cfab134d008039e1229e42a96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_315dd9cfab134d008039e1229e42a96e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/315dd9cfab134d008039e1229e42a96e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:47:35.496781 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeShelveTestJSON-23441539 Jul 01 16:47:35.496781 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 315dd9cfab134d008039e1229e42a96e Jul 01 16:47:35.496781 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-23441539 Jul 01 16:47:35.496781 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeShelveTestJSON-23441539-project Jul 01 16:47:35.496781 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:47:35.496781 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:47:35.496781 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: e471b31763074167ba81c2c25f39b857 Jul 01 16:47:35.496781 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeShelveTestJSON-23441539-project Jul 01 16:47:35.496781 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:47:35.496781 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance d8d5cf19-9bb2-4534-8076-564fb7538cad could not be found. Jul 01 16:47:35.496781 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': 'd8d5cf19-9bb2-4534-8076-564fb7538cad'} Jul 01 16:47:35.497663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:47:35.497663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:35.497663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:47:35.497663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:47:35.497663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:47:35.497663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:47:35.497663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:47:35.497663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:47:35.497663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:47:35.497663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:47:35.497663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8d5cf19-9bb2-4534-8076-564fb7538cad could not be found. Jul 01 16:47:35.497663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:35.497663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:35.497663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:35.497663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:35.497663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:35.497663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:35.497663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:47:35.497663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:47:35.497663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:47:35.499185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:47:35.499185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:47:35.499185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:47:35.499185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:47:35.499185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:47:35.499185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:47:35.499185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:47:35.499185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8d5cf19-9bb2-4534-8076-564fb7538cad could not be found. Jul 01 16:47:35.499185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:35.499185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:35.499185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:35.499185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:35.499185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:35.499185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:35.499185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:47:35.499185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:47:35.499185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8d5cf19-9bb2-4534-8076-564fb7538cad could not be found. Jul 01 16:47:35.499185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:35.501891 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-61874781-4207-49d9-8479-97bd59b91768 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Returning 404 to user: Instance d8d5cf19-9bb2-4534-8076-564fb7538cad could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:47:35.502942 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-61874781-4207-49d9-8479-97bd59b91768 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 404 len: 111 microversion: 2.20 time: 0.042586 Jul 01 16:47:35.503686 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 429/853] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:47:35 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 16:47:35.514964 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b9ef5f93-f022-41e2-889b-24df30dd7c56 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '.version_select at 0x7fa85f1f7040>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:35.536091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b9ef5f93-f022-41e2-889b-24df30dd7c56 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1037522237" status: 204 len: 0 microversion: 2.20 time: 0.027378 Jul 01 16:47:35.537795 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 425/854] 10.222.0.57 () {60 vars in 1261 bytes} [Fri Jul 1 16:47:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1037522237 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 01 16:47:35.853720 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8388654b-1f31-46ca-8840-6fdcab6268f2 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:35.855599 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8388654b-1f31-46ca-8840-6fdcab6268f2 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:35.863846 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8388654b-1f31-46ca-8840-6fdcab6268f2 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:35.864572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8388654b-1f31-46ca-8840-6fdcab6268f2 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:35.866186 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8388654b-1f31-46ca-8840-6fdcab6268f2 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:35.866823 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8388654b-1f31-46ca-8840-6fdcab6268f2 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:36.354440 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8388654b-1f31-46ca-8840-6fdcab6268f2 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:36.362557 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8388654b-1f31-46ca-8840-6fdcab6268f2 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e" status: 200 len: 1266 microversion: 2.1 time: 0.515715 Jul 01 16:47:36.374015 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 430/855] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:35 2022] GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e => generated 1266 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:36.386374 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-25e1d98d-ef6a-4b22-a66c-cf57b2b71b2c req-90ba38bd-8ec3-4dc9-9133-4bb6375e8b54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e", "tag": "b189e3e5-619a-4eff-907c-88d68b95600f"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:47:36.401335 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-25e1d98d-ef6a-4b22-a66c-cf57b2b71b2c req-90ba38bd-8ec3-4dc9-9133-4bb6375e8b54 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:36.402172 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-25e1d98d-ef6a-4b22-a66c-cf57b2b71b2c req-90ba38bd-8ec3-4dc9-9133-4bb6375e8b54 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:36.416471 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-25e1d98d-ef6a-4b22-a66c-cf57b2b71b2c req-90ba38bd-8ec3-4dc9-9133-4bb6375e8b54 service nova] Creating event network-changed:b189e3e5-619a-4eff-907c-88d68b95600f for instance c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e on hv-cinder-79760 Jul 01 16:47:36.423445 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-25e1d98d-ef6a-4b22-a66c-cf57b2b71b2c req-90ba38bd-8ec3-4dc9-9133-4bb6375e8b54 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047585 Jul 01 16:47:36.425066 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 426/856] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:47:37.382612 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2c2fe38c-2b5c-4282-87de-ab10d99e9722 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:37.383227 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2c2fe38c-2b5c-4282-87de-ab10d99e9722 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:37.391251 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2c2fe38c-2b5c-4282-87de-ab10d99e9722 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:37.391707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2c2fe38c-2b5c-4282-87de-ab10d99e9722 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:37.393165 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2c2fe38c-2b5c-4282-87de-ab10d99e9722 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:37.393921 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2c2fe38c-2b5c-4282-87de-ab10d99e9722 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:37.637359 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2c2fe38c-2b5c-4282-87de-ab10d99e9722 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:37.647663 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2c2fe38c-2b5c-4282-87de-ab10d99e9722 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e" status: 200 len: 1266 microversion: 2.1 time: 0.270495 Jul 01 16:47:37.657141 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 431/857] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:37 2022] GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:38.056114 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3c64d6a8-23c9-44da-b3eb-9e8eaf739a9d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:38.057306 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3c64d6a8-23c9-44da-b3eb-9e8eaf739a9d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:38.064988 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3c64d6a8-23c9-44da-b3eb-9e8eaf739a9d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:38.065727 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3c64d6a8-23c9-44da-b3eb-9e8eaf739a9d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:38.066765 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3c64d6a8-23c9-44da-b3eb-9e8eaf739a9d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:38.067362 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3c64d6a8-23c9-44da-b3eb-9e8eaf739a9d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:38.082303 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-3c64d6a8-23c9-44da-b3eb-9e8eaf739a9d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] HTTP exception thrown: Instance d8d5cf19-9bb2-4534-8076-564fb7538cad could not be found. Jul 01 16:47:38.084504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3c64d6a8-23c9-44da-b3eb-9e8eaf739a9d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Request method failure captured: Jul 01 16:47:38.084504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: DELETE /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad HTTP/1.1 Jul 01 16:47:38.084504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:47:38.084504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:47:38.084504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:47:38.084504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:47:38.084504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:47:38.084504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:47:38.084504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:47:38.084504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:47:38.084504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyOEX7ZmlTowDJwBQle8fYRN6IIl6cTBoh3cWOEW-kmdqj74LprtFmwsfqVRVjL-Wk63ndafCHfHFjx80r_bi-PQhBVTV7Gpu8Kd94vqCVQXw25-3mUMpJW2YxXzdceSiVS31Af7uO0Trb3QuorNPILu2OHvdPrBv3nnbYzAn2_m4b0 Jul 01 16:47:38.084504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:47:38.084504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:47:38.084504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:47:38.084504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:47:38.084504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 16:47:38.084504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:47:38.084504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:47:38.084504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: 315dd9cfab134d008039e1229e42a96e Jul 01 16:47:38.084504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-23441539 Jul 01 16:47:38.084504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:47:38.084504 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:47:38.086149 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/315dd9cfab134d008039e1229e42a96e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/315dd9cfab134d008039e1229e42a96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_315dd9cfab134d008039e1229e42a96e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/315dd9cfab134d008039e1229e42a96e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:47:38.086149 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeShelveTestJSON-23441539 Jul 01 16:47:38.086149 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 315dd9cfab134d008039e1229e42a96e Jul 01 16:47:38.086149 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-23441539 Jul 01 16:47:38.086149 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeShelveTestJSON-23441539-project Jul 01 16:47:38.086149 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:47:38.086149 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:47:38.086149 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: e471b31763074167ba81c2c25f39b857 Jul 01 16:47:38.086149 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeShelveTestJSON-23441539-project Jul 01 16:47:38.086149 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: > Jul 01 16:47:38.086149 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Instance d8d5cf19-9bb2-4534-8076-564fb7538cad could not be found. Jul 01 16:47:38.086149 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'id': 'd8d5cf19-9bb2-4534-8076-564fb7538cad'} Jul 01 16:47:38.087087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:47:38.087087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:38.087087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:47:38.087087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:47:38.087087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:47:38.087087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:47:38.087087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:47:38.087087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:47:38.087087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:47:38.087087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:47:38.087087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8d5cf19-9bb2-4534-8076-564fb7538cad could not be found. Jul 01 16:47:38.087087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:38.087087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:38.087087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:38.087087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:38.087087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:38.087087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:38.087087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:47:38.087087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:47:38.087087 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:47:38.088552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:47:38.088552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 16:47:38.088552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 16:47:38.088552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 16:47:38.088552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 16:47:38.088552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:47:38.088552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:47:38.088552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:47:38.088552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:47:38.088552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8d5cf19-9bb2-4534-8076-564fb7538cad could not be found. Jul 01 16:47:38.088552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:38.088552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:38.088552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:38.088552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:38.088552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:38.088552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:38.088552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:47:38.088552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:47:38.088552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8d5cf19-9bb2-4534-8076-564fb7538cad could not be found. Jul 01 16:47:38.088552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:38.090884 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3c64d6a8-23c9-44da-b3eb-9e8eaf739a9d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Returning 404 to user: Instance d8d5cf19-9bb2-4534-8076-564fb7538cad could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:47:38.091922 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3c64d6a8-23c9-44da-b3eb-9e8eaf739a9d tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 404 len: 111 microversion: 2.20 time: 0.040794 Jul 01 16:47:38.093011 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 427/858] 10.222.0.57 () {60 vars in 1279 bytes} [Fri Jul 1 16:47:38 2022] DELETE /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 16:47:38.101138 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-66a03cfe-d1b8-438e-a28d-7a45cf4792aa tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:38.101856 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-66a03cfe-d1b8-438e-a28d-7a45cf4792aa tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: d8d5cf19-9bb2-4534-8076-564fb7538cad] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:38.111826 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-66a03cfe-d1b8-438e-a28d-7a45cf4792aa tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:38.114076 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-66a03cfe-d1b8-438e-a28d-7a45cf4792aa tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:38.114999 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-66a03cfe-d1b8-438e-a28d-7a45cf4792aa tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:38.116418 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-66a03cfe-d1b8-438e-a28d-7a45cf4792aa tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:38.154953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-66a03cfe-d1b8-438e-a28d-7a45cf4792aa tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] HTTP exception thrown: Instance d8d5cf19-9bb2-4534-8076-564fb7538cad could not be found. Jul 01 16:47:38.156733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-66a03cfe-d1b8-438e-a28d-7a45cf4792aa tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Request method failure captured: Jul 01 16:47:38.156733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad HTTP/1.1 Jul 01 16:47:38.156733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:47:38.156733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:47:38.156733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:47:38.156733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:47:38.156733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:47:38.156733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:47:38.156733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:47:38.156733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:47:38.156733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyOEX7ZmlTowDJwBQle8fYRN6IIl6cTBoh3cWOEW-kmdqj74LprtFmwsfqVRVjL-Wk63ndafCHfHFjx80r_bi-PQhBVTV7Gpu8Kd94vqCVQXw25-3mUMpJW2YxXzdceSiVS31Af7uO0Trb3QuorNPILu2OHvdPrBv3nnbYzAn2_m4b0 Jul 01 16:47:38.156733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:47:38.156733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:47:38.156733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:47:38.156733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:47:38.156733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 16:47:38.156733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:47:38.156733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:47:38.156733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: 315dd9cfab134d008039e1229e42a96e Jul 01 16:47:38.156733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-23441539 Jul 01 16:47:38.156733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:47:38.156733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:47:38.158424 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/315dd9cfab134d008039e1229e42a96e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/315dd9cfab134d008039e1229e42a96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_315dd9cfab134d008039e1229e42a96e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/315dd9cfab134d008039e1229e42a96e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:47:38.158424 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeShelveTestJSON-23441539 Jul 01 16:47:38.158424 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 315dd9cfab134d008039e1229e42a96e Jul 01 16:47:38.158424 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-23441539 Jul 01 16:47:38.158424 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeShelveTestJSON-23441539-project Jul 01 16:47:38.158424 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:47:38.158424 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:47:38.158424 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: e471b31763074167ba81c2c25f39b857 Jul 01 16:47:38.158424 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeShelveTestJSON-23441539-project Jul 01 16:47:38.158424 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:47:38.158424 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance d8d5cf19-9bb2-4534-8076-564fb7538cad could not be found. Jul 01 16:47:38.158424 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': 'd8d5cf19-9bb2-4534-8076-564fb7538cad'} Jul 01 16:47:38.159269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:47:38.159269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:38.159269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:47:38.159269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:47:38.159269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:47:38.159269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:47:38.159269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:47:38.159269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:47:38.159269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:47:38.159269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:47:38.159269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8d5cf19-9bb2-4534-8076-564fb7538cad could not be found. Jul 01 16:47:38.159269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:38.159269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:38.159269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:38.159269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:38.159269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:38.159269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:38.159269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:47:38.159269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:47:38.159269 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:47:38.160494 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:47:38.160494 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:47:38.160494 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:47:38.160494 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:47:38.160494 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:47:38.160494 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:47:38.160494 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:47:38.160494 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8d5cf19-9bb2-4534-8076-564fb7538cad could not be found. Jul 01 16:47:38.160494 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:38.160494 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:38.160494 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:38.160494 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:38.160494 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:38.160494 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:38.160494 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:47:38.160494 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:47:38.160494 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8d5cf19-9bb2-4534-8076-564fb7538cad could not be found. Jul 01 16:47:38.160494 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:38.163670 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-66a03cfe-d1b8-438e-a28d-7a45cf4792aa tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Returning 404 to user: Instance d8d5cf19-9bb2-4534-8076-564fb7538cad could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:47:38.164755 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-66a03cfe-d1b8-438e-a28d-7a45cf4792aa tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad" status: 404 len: 111 microversion: 2.20 time: 0.067659 Jul 01 16:47:38.165518 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 432/859] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:47:38 2022] GET /compute/v2.1/servers/d8d5cf19-9bb2-4534-8076-564fb7538cad => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 16:47:38.665139 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d39df55f-c85b-4af8-98d9-c14e3a807939 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:38.665772 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d39df55f-c85b-4af8-98d9-c14e3a807939 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:38.674701 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d39df55f-c85b-4af8-98d9-c14e3a807939 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:38.675176 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d39df55f-c85b-4af8-98d9-c14e3a807939 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:38.675957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d39df55f-c85b-4af8-98d9-c14e3a807939 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:38.676395 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d39df55f-c85b-4af8-98d9-c14e3a807939 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:38.821552 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d39df55f-c85b-4af8-98d9-c14e3a807939 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:38.830320 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d39df55f-c85b-4af8-98d9-c14e3a807939 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e" status: 200 len: 1266 microversion: 2.1 time: 0.168651 Jul 01 16:47:38.830927 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 428/860] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:38 2022] GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:39.328797 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8747fb08-2bc8-4526-aef2-5ba90be1d550 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:39.329228 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8747fb08-2bc8-4526-aef2-5ba90be1d550 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:39.336921 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8747fb08-2bc8-4526-aef2-5ba90be1d550 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:39.337372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8747fb08-2bc8-4526-aef2-5ba90be1d550 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:39.338137 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8747fb08-2bc8-4526-aef2-5ba90be1d550 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:39.338600 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8747fb08-2bc8-4526-aef2-5ba90be1d550 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:39.353707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-8747fb08-2bc8-4526-aef2-5ba90be1d550 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] HTTP exception thrown: Instance 8498c0a8-d20e-4261-a0a1-d4c33004141c could not be found. Jul 01 16:47:39.355275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8747fb08-2bc8-4526-aef2-5ba90be1d550 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Request method failure captured: Jul 01 16:47:39.355275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: DELETE /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c HTTP/1.1 Jul 01 16:47:39.355275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:47:39.355275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:47:39.355275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:47:39.355275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:47:39.355275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:47:39.355275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:47:39.355275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:47:39.355275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:47:39.355275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyOEX7ZmlTowDJwBQle8fYRN6IIl6cTBoh3cWOEW-kmdqj74LprtFmwsfqVRVjL-Wk63ndafCHfHFjx80r_bi-PQhBVTV7Gpu8Kd94vqCVQXw25-3mUMpJW2YxXzdceSiVS31Af7uO0Trb3QuorNPILu2OHvdPrBv3nnbYzAn2_m4b0 Jul 01 16:47:39.355275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:47:39.355275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:47:39.355275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:47:39.355275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:47:39.355275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 16:47:39.355275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:47:39.355275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:47:39.355275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: 315dd9cfab134d008039e1229e42a96e Jul 01 16:47:39.355275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-23441539 Jul 01 16:47:39.355275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:47:39.355275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:47:39.357001 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/315dd9cfab134d008039e1229e42a96e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/315dd9cfab134d008039e1229e42a96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_315dd9cfab134d008039e1229e42a96e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/315dd9cfab134d008039e1229e42a96e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:47:39.357001 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeShelveTestJSON-23441539 Jul 01 16:47:39.357001 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 315dd9cfab134d008039e1229e42a96e Jul 01 16:47:39.357001 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-23441539 Jul 01 16:47:39.357001 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeShelveTestJSON-23441539-project Jul 01 16:47:39.357001 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:47:39.357001 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:47:39.357001 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: e471b31763074167ba81c2c25f39b857 Jul 01 16:47:39.357001 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeShelveTestJSON-23441539-project Jul 01 16:47:39.357001 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:47:39.357001 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance 8498c0a8-d20e-4261-a0a1-d4c33004141c could not be found. Jul 01 16:47:39.357001 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': '8498c0a8-d20e-4261-a0a1-d4c33004141c'} Jul 01 16:47:39.357932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:47:39.357932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:39.357932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:47:39.357932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:47:39.357932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:47:39.357932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:47:39.357932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:47:39.357932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:47:39.357932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:47:39.357932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:47:39.357932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8498c0a8-d20e-4261-a0a1-d4c33004141c could not be found. Jul 01 16:47:39.357932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:39.357932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:39.357932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:39.357932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:39.357932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:39.357932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:39.357932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:47:39.357932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:47:39.357932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:47:39.359503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:47:39.359503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 16:47:39.359503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 16:47:39.359503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 16:47:39.359503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 16:47:39.359503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:47:39.359503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:47:39.359503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:47:39.359503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:47:39.359503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8498c0a8-d20e-4261-a0a1-d4c33004141c could not be found. Jul 01 16:47:39.359503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:39.359503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:39.359503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:39.359503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:39.359503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:39.359503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:39.359503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:47:39.359503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:47:39.359503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8498c0a8-d20e-4261-a0a1-d4c33004141c could not be found. Jul 01 16:47:39.359503 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:47:39.361386 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8747fb08-2bc8-4526-aef2-5ba90be1d550 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Returning 404 to user: Instance 8498c0a8-d20e-4261-a0a1-d4c33004141c could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:47:39.361386 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8747fb08-2bc8-4526-aef2-5ba90be1d550 tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 404 len: 111 microversion: 2.20 time: 0.031829 Jul 01 16:47:39.365482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 433/861] 10.222.0.57 () {60 vars in 1279 bytes} [Fri Jul 1 16:47:39 2022] DELETE /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 16:47:39.366935 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-29437926-e4c2-426c-a28e-311bc8572acc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:39.368168 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-29437926-e4c2-426c-a28e-311bc8572acc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] [instance: 8498c0a8-d20e-4261-a0a1-d4c33004141c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:39.374877 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-29437926-e4c2-426c-a28e-311bc8572acc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:39.375454 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-29437926-e4c2-426c-a28e-311bc8572acc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:39.376875 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-29437926-e4c2-426c-a28e-311bc8572acc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:39.377417 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-29437926-e4c2-426c-a28e-311bc8572acc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:39.550478 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-29437926-e4c2-426c-a28e-311bc8572acc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] HTTP exception thrown: Instance 8498c0a8-d20e-4261-a0a1-d4c33004141c could not be found. Jul 01 16:47:39.552033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-29437926-e4c2-426c-a28e-311bc8572acc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Request method failure captured: Jul 01 16:47:39.552033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c HTTP/1.1 Jul 01 16:47:39.552033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:47:39.552033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:47:39.552033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:47:39.552033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:47:39.552033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:47:39.552033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:47:39.552033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:47:39.552033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:47:39.552033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyOEX7ZmlTowDJwBQle8fYRN6IIl6cTBoh3cWOEW-kmdqj74LprtFmwsfqVRVjL-Wk63ndafCHfHFjx80r_bi-PQhBVTV7Gpu8Kd94vqCVQXw25-3mUMpJW2YxXzdceSiVS31Af7uO0Trb3QuorNPILu2OHvdPrBv3nnbYzAn2_m4b0 Jul 01 16:47:39.552033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:47:39.552033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:47:39.552033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:47:39.552033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:47:39.552033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 16:47:39.552033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:47:39.552033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:47:39.552033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: 315dd9cfab134d008039e1229e42a96e Jul 01 16:47:39.552033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-23441539 Jul 01 16:47:39.552033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:47:39.552033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:47:39.553778 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/315dd9cfab134d008039e1229e42a96e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/315dd9cfab134d008039e1229e42a96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_315dd9cfab134d008039e1229e42a96e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/315dd9cfab134d008039e1229e42a96e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:47:39.553778 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeShelveTestJSON-23441539 Jul 01 16:47:39.553778 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 315dd9cfab134d008039e1229e42a96e Jul 01 16:47:39.553778 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-23441539 Jul 01 16:47:39.553778 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeShelveTestJSON-23441539-project Jul 01 16:47:39.553778 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:47:39.553778 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:47:39.553778 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: e471b31763074167ba81c2c25f39b857 Jul 01 16:47:39.553778 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeShelveTestJSON-23441539-project Jul 01 16:47:39.553778 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: > Jul 01 16:47:39.553778 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Instance 8498c0a8-d20e-4261-a0a1-d4c33004141c could not be found. Jul 01 16:47:39.553778 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'id': '8498c0a8-d20e-4261-a0a1-d4c33004141c'} Jul 01 16:47:39.554732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:47:39.554732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:39.554732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:47:39.554732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:47:39.554732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:47:39.554732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:47:39.554732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:47:39.554732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:47:39.554732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:47:39.554732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:47:39.554732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8498c0a8-d20e-4261-a0a1-d4c33004141c could not be found. Jul 01 16:47:39.554732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:39.554732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:39.554732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:39.554732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:39.554732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:39.554732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:39.554732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:47:39.554732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:47:39.554732 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:47:39.556538 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:47:39.556538 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:47:39.556538 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:47:39.556538 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:47:39.556538 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:47:39.556538 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:47:39.556538 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:47:39.556538 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8498c0a8-d20e-4261-a0a1-d4c33004141c could not be found. Jul 01 16:47:39.556538 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:39.556538 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:47:39.556538 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:39.556538 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:47:39.556538 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:47:39.556538 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:47:39.556538 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:47:39.556538 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:47:39.556538 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8498c0a8-d20e-4261-a0a1-d4c33004141c could not be found. Jul 01 16:47:39.556538 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:47:39.557887 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-29437926-e4c2-426c-a28e-311bc8572acc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] Returning 404 to user: Instance 8498c0a8-d20e-4261-a0a1-d4c33004141c could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:47:39.557887 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-29437926-e4c2-426c-a28e-311bc8572acc tempest-AttachVolumeShelveTestJSON-23441539 tempest-AttachVolumeShelveTestJSON-23441539-project] 10.222.0.57 "GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c" status: 404 len: 111 microversion: 2.20 time: 0.191751 Jul 01 16:47:39.557887 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 429/862] 10.222.0.57 () {60 vars in 1276 bytes} [Fri Jul 1 16:47:39 2022] GET /compute/v2.1/servers/8498c0a8-d20e-4261-a0a1-d4c33004141c => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 16:47:39.855325 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8c512ff2-45fb-48a6-a25c-7446702c72bb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:39.856502 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8c512ff2-45fb-48a6-a25c-7446702c72bb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:39.865783 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8c512ff2-45fb-48a6-a25c-7446702c72bb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:39.866507 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8c512ff2-45fb-48a6-a25c-7446702c72bb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:39.867275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8c512ff2-45fb-48a6-a25c-7446702c72bb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:39.867999 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8c512ff2-45fb-48a6-a25c-7446702c72bb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:40.090327 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8c512ff2-45fb-48a6-a25c-7446702c72bb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:40.098322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8c512ff2-45fb-48a6-a25c-7446702c72bb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e" status: 200 len: 1266 microversion: 2.1 time: 0.250185 Jul 01 16:47:40.099050 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 434/863] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:39 2022] GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:41.116175 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-97a03c5a-503f-4c3c-a48e-209b6bd78e31 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:41.116799 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-97a03c5a-503f-4c3c-a48e-209b6bd78e31 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:41.125294 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-97a03c5a-503f-4c3c-a48e-209b6bd78e31 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:41.125994 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-97a03c5a-503f-4c3c-a48e-209b6bd78e31 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:41.127896 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-97a03c5a-503f-4c3c-a48e-209b6bd78e31 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:41.128413 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-97a03c5a-503f-4c3c-a48e-209b6bd78e31 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:41.291619 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-97a03c5a-503f-4c3c-a48e-209b6bd78e31 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:41.299710 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-97a03c5a-503f-4c3c-a48e-209b6bd78e31 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e" status: 200 len: 1266 microversion: 2.1 time: 0.187211 Jul 01 16:47:41.300278 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 430/864] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:41 2022] GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:47:42.321953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f1e1f09f-50d2-4d81-b26b-4f13ad7d1ba8 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:42.324439 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f1e1f09f-50d2-4d81-b26b-4f13ad7d1ba8 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:42.346487 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f1e1f09f-50d2-4d81-b26b-4f13ad7d1ba8 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:42.346935 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f1e1f09f-50d2-4d81-b26b-4f13ad7d1ba8 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:42.350951 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f1e1f09f-50d2-4d81-b26b-4f13ad7d1ba8 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:42.351602 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f1e1f09f-50d2-4d81-b26b-4f13ad7d1ba8 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:42.410324 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:47:42.524738 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f1e1f09f-50d2-4d81-b26b-4f13ad7d1ba8 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:42.534514 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f1e1f09f-50d2-4d81-b26b-4f13ad7d1ba8 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e" status: 200 len: 1266 microversion: 2.1 time: 0.219645 Jul 01 16:47:42.535743 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 435/865] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:42 2022] GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:43.553802 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-901fce69-8eb1-4c74-82b9-4ca8c6d84214 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:43.554603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-901fce69-8eb1-4c74-82b9-4ca8c6d84214 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:43.560135 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:47:43.561605 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=6 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:47:43.563490 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-901fce69-8eb1-4c74-82b9-4ca8c6d84214 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:43.564280 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-901fce69-8eb1-4c74-82b9-4ca8c6d84214 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:43.565411 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-901fce69-8eb1-4c74-82b9-4ca8c6d84214 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:43.565854 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-901fce69-8eb1-4c74-82b9-4ca8c6d84214 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:43.754817 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-901fce69-8eb1-4c74-82b9-4ca8c6d84214 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:43.767265 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-901fce69-8eb1-4c74-82b9-4ca8c6d84214 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e" status: 200 len: 1266 microversion: 2.1 time: 0.217511 Jul 01 16:47:43.768277 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 431/866] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:43 2022] GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:44.783739 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d290840f-3f02-4736-82c4-042b0117eacb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:44.784581 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d290840f-3f02-4736-82c4-042b0117eacb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:44.796141 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d290840f-3f02-4736-82c4-042b0117eacb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:44.796609 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d290840f-3f02-4736-82c4-042b0117eacb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:44.797479 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d290840f-3f02-4736-82c4-042b0117eacb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:44.798440 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d290840f-3f02-4736-82c4-042b0117eacb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:45.008318 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d290840f-3f02-4736-82c4-042b0117eacb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:45.016587 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d290840f-3f02-4736-82c4-042b0117eacb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e" status: 200 len: 1266 microversion: 2.1 time: 0.236670 Jul 01 16:47:45.029937 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 436/867] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:44 2022] GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:46.037745 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-eef5960f-874f-47a9-a7c8-baeacd7264a1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:46.039297 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-eef5960f-874f-47a9-a7c8-baeacd7264a1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:46.046655 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eef5960f-874f-47a9-a7c8-baeacd7264a1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:46.047241 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eef5960f-874f-47a9-a7c8-baeacd7264a1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:46.048484 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eef5960f-874f-47a9-a7c8-baeacd7264a1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:46.049246 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eef5960f-874f-47a9-a7c8-baeacd7264a1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:46.231887 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-eef5960f-874f-47a9-a7c8-baeacd7264a1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:46.240352 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-eef5960f-874f-47a9-a7c8-baeacd7264a1 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e" status: 200 len: 1266 microversion: 2.1 time: 0.207979 Jul 01 16:47:46.245997 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 432/868] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:46 2022] GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:46.451972 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-d7f38add-4846-478b-8864-5d786db52e4d req-2a15b675-d11b-41b2-8d30-6e0de4da20e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e", "name": "network-vif-plugged", "status": "completed", "tag": "b189e3e5-619a-4eff-907c-88d68b95600f"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:47:46.465817 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-d7f38add-4846-478b-8864-5d786db52e4d req-2a15b675-d11b-41b2-8d30-6e0de4da20e1 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:46.467170 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-d7f38add-4846-478b-8864-5d786db52e4d req-2a15b675-d11b-41b2-8d30-6e0de4da20e1 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:46.482924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:47:46.486943 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-d7f38add-4846-478b-8864-5d786db52e4d req-2a15b675-d11b-41b2-8d30-6e0de4da20e1 service nova] Creating event network-vif-plugged:b189e3e5-619a-4eff-907c-88d68b95600f for instance c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e on hv-cinder-79760 Jul 01 16:47:46.495023 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-d7f38add-4846-478b-8864-5d786db52e4d req-2a15b675-d11b-41b2-8d30-6e0de4da20e1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046008 Jul 01 16:47:46.495894 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 437/869] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:47:47.260286 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c6b53399-9edc-41d9-970d-6f05441ba140 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:47.261079 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c6b53399-9edc-41d9-970d-6f05441ba140 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:47.268269 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c6b53399-9edc-41d9-970d-6f05441ba140 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:47.268848 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c6b53399-9edc-41d9-970d-6f05441ba140 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:47.269748 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c6b53399-9edc-41d9-970d-6f05441ba140 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:47.270321 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c6b53399-9edc-41d9-970d-6f05441ba140 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:47.431482 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c6b53399-9edc-41d9-970d-6f05441ba140 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:47.440505 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c6b53399-9edc-41d9-970d-6f05441ba140 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e" status: 200 len: 1266 microversion: 2.1 time: 0.183915 Jul 01 16:47:47.441262 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 433/870] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:47 2022] GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:48.460373 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b0398e66-2369-436e-8e07-d4bb6830e727 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:48.461277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b0398e66-2369-436e-8e07-d4bb6830e727 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:48.468744 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b0398e66-2369-436e-8e07-d4bb6830e727 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:48.469798 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b0398e66-2369-436e-8e07-d4bb6830e727 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:48.471042 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b0398e66-2369-436e-8e07-d4bb6830e727 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:48.471488 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b0398e66-2369-436e-8e07-d4bb6830e727 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:48.634895 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b0398e66-2369-436e-8e07-d4bb6830e727 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:48.655959 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b0398e66-2369-436e-8e07-d4bb6830e727 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e" status: 200 len: 1452 microversion: 2.1 time: 0.202548 Jul 01 16:47:48.666959 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 438/871] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:48 2022] GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e => generated 1452 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:48.675649 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-921c3d68-a82f-447e-ab16-af52b777a246 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:48.676268 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-921c3d68-a82f-447e-ab16-af52b777a246 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:48.682708 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-921c3d68-a82f-447e-ab16-af52b777a246 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:48.683254 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-921c3d68-a82f-447e-ab16-af52b777a246 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:48.684103 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-921c3d68-a82f-447e-ab16-af52b777a246 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:48.684687 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-921c3d68-a82f-447e-ab16-af52b777a246 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:48.858928 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-921c3d68-a82f-447e-ab16-af52b777a246 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:48.869104 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-921c3d68-a82f-447e-ab16-af52b777a246 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e" status: 200 len: 1452 microversion: 2.1 time: 0.199386 Jul 01 16:47:48.870403 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 434/872] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:48 2022] GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e => generated 1452 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:49.561250 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8a6e8590-2cac-47ee-9da6-a65e43492024 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Action: 'create', calling method: .version_select at 0x7fa86c2b21f0>, body: {"keypair": {"name": "tempest-keypair-1763066210", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWUOvwhIuF9DDoVBzJ3laMJucZzC3F5PQNf64PUb41dBbuwRR+vSFF7geuNsZwcGaaeQMUgHDsg7RHJRr9rvKy3S/0tWyKM/UJPjGYggPTxIyMBYF1gdqzqGacNl142jg=="}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:47:49.577167 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-8a6e8590-2cac-47ee-9da6-a65e43492024 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Getting quotas for project b1b152a7ad4d44f8a292995a1598d238. Resources: {'key_pairs'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:47:49.586332 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-8a6e8590-2cac-47ee-9da6-a65e43492024 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Getting quotas for user f25bcb63e6194aa9884e589db9f7ede6 and project b1b152a7ad4d44f8a292995a1598d238. Resources: {'key_pairs'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:47:49.615704 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8a6e8590-2cac-47ee-9da6-a65e43492024 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.230647 Jul 01 16:47:49.623208 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 439/873] 10.222.0.57 () {60 vars in 1158 bytes} [Fri Jul 1 16:47:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:47:51.214779 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-dd237ce6-3198-451f-9fe3-e9008ac9450f req-ddeaa467-fbdb-4dce-8ac4-1efdaf7e9f32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e", "tag": "b189e3e5-619a-4eff-907c-88d68b95600f"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:47:51.235894 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-dd237ce6-3198-451f-9fe3-e9008ac9450f req-ddeaa467-fbdb-4dce-8ac4-1efdaf7e9f32 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:51.243340 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-dd237ce6-3198-451f-9fe3-e9008ac9450f req-ddeaa467-fbdb-4dce-8ac4-1efdaf7e9f32 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:51.260445 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-dd237ce6-3198-451f-9fe3-e9008ac9450f req-ddeaa467-fbdb-4dce-8ac4-1efdaf7e9f32 service nova] Creating event network-changed:b189e3e5-619a-4eff-907c-88d68b95600f for instance c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e on hv-cinder-79760 Jul 01 16:47:51.284450 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-dd237ce6-3198-451f-9fe3-e9008ac9450f req-ddeaa467-fbdb-4dce-8ac4-1efdaf7e9f32 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077111 Jul 01 16:47:51.290657 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 435/874] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:47:51.462740 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c4fe1325-d6dd-4998-bcf3-091c503fca0c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-572086745", "imageRef": "42a4b1a9-dea6-4c87-a2c1-328b9c0c8558", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b36dbd7-72b5-4d72-9df6-342ee9de795a"}], "security_groups": [{"name": "tempest-securitygroup--1420164802"}], "key_name": "tempest-keypair-1763066210", "user_data": "}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:47:51.675774 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.network.neutron [None req-c4fe1325-d6dd-4998-bcf3-091c503fca0c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] validate_networks() for [('3b36dbd7-72b5-4d72-9df6-342ee9de795a', None, None, None, None, None)] {{(pid=124317) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 16:47:52.444532 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-c4fe1325-d6dd-4998-bcf3-091c503fca0c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Flavor limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 16:47:52.444961 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-c4fe1325-d6dd-4998-bcf3-091c503fca0c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Image limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 16:47:52.445452 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-c4fe1325-d6dd-4998-bcf3-091c503fca0c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Flavor pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 16:47:52.445913 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-c4fe1325-d6dd-4998-bcf3-091c503fca0c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Image pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 16:47:52.446413 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-c4fe1325-d6dd-4998-bcf3-091c503fca0c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 16:47:52.458414 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c4fe1325-d6dd-4998-bcf3-091c503fca0c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:52.458972 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c4fe1325-d6dd-4998-bcf3-091c503fca0c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:52.461315 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c4fe1325-d6dd-4998-bcf3-091c503fca0c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:52.461943 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c4fe1325-d6dd-4998-bcf3-091c503fca0c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:52.483623 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-c4fe1325-d6dd-4998-bcf3-091c503fca0c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Getting quotas for project b1b152a7ad4d44f8a292995a1598d238. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:47:52.493262 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-c4fe1325-d6dd-4998-bcf3-091c503fca0c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Getting quotas for user f25bcb63e6194aa9884e589db9f7ede6 and project b1b152a7ad4d44f8a292995a1598d238. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:47:52.512894 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c4fe1325-d6dd-4998-bcf3-091c503fca0c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Going to run 1 instances... {{(pid=124317) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 16:47:52.518076 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c4fe1325-d6dd-4998-bcf3-091c503fca0c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42a4b1a9-dea6-4c87-a2c1-328b9c0c8558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124317) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 16:47:52.580798 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c4fe1325-d6dd-4998-bcf3-091c503fca0c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.130092 Jul 01 16:47:52.582583 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 440/875] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 1 16:47:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 16:47:52.592506 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a31499db-c242-4bb7-a2ba-e0f941e09ae6 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:52.593784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a31499db-c242-4bb7-a2ba-e0f941e09ae6 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:52.662626 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a31499db-c242-4bb7-a2ba-e0f941e09ae6 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:52.669408 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a31499db-c242-4bb7-a2ba-e0f941e09ae6 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1237 microversion: 2.1 time: 0.081532 Jul 01 16:47:52.673003 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 436/876] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:52 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:53.696938 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-59b3a1b3-a9dd-448b-b757-6261debe9eba tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:53.703223 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-59b3a1b3-a9dd-448b-b757-6261debe9eba tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:53.714027 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-59b3a1b3-a9dd-448b-b757-6261debe9eba tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:53.714893 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-59b3a1b3-a9dd-448b-b757-6261debe9eba tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:53.715930 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-59b3a1b3-a9dd-448b-b757-6261debe9eba tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:53.716641 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-59b3a1b3-a9dd-448b-b757-6261debe9eba tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:53.888810 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-59b3a1b3-a9dd-448b-b757-6261debe9eba tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:53.901698 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-59b3a1b3-a9dd-448b-b757-6261debe9eba tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1297 microversion: 2.1 time: 0.211922 Jul 01 16:47:53.904917 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 441/877] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:53 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1297 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:54.925237 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-892f5b5e-5e99-492b-a06b-d6111cb87063 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:54.925828 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-892f5b5e-5e99-492b-a06b-d6111cb87063 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:54.937616 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-892f5b5e-5e99-492b-a06b-d6111cb87063 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:54.938139 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-892f5b5e-5e99-492b-a06b-d6111cb87063 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:54.939077 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-892f5b5e-5e99-492b-a06b-d6111cb87063 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:54.939579 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-892f5b5e-5e99-492b-a06b-d6111cb87063 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:55.418038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-892f5b5e-5e99-492b-a06b-d6111cb87063 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:55.426227 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-892f5b5e-5e99-492b-a06b-d6111cb87063 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1363 microversion: 2.1 time: 0.508971 Jul 01 16:47:55.426813 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 437/878] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:54 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1363 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:55.728010 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-2e84dd12-396f-4046-b3a2-8a0640a037bf req-8dc3b261-11a8-4a2a-972f-b582bf53d8cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6c54f9e-6923-4f5c-a7de-be304f3587dc", "tag": "15751548-66ba-4e21-a18e-20e6858b091e"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:47:55.740205 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-2e84dd12-396f-4046-b3a2-8a0640a037bf req-8dc3b261-11a8-4a2a-972f-b582bf53d8cc service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:55.741059 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-2e84dd12-396f-4046-b3a2-8a0640a037bf req-8dc3b261-11a8-4a2a-972f-b582bf53d8cc service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:55.769465 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-2e84dd12-396f-4046-b3a2-8a0640a037bf req-8dc3b261-11a8-4a2a-972f-b582bf53d8cc service nova] Creating event network-changed:15751548-66ba-4e21-a18e-20e6858b091e for instance f6c54f9e-6923-4f5c-a7de-be304f3587dc on hv-cinder-79760 Jul 01 16:47:55.775472 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-2e84dd12-396f-4046-b3a2-8a0640a037bf req-8dc3b261-11a8-4a2a-972f-b582bf53d8cc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053209 Jul 01 16:47:55.776284 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 442/879] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:47:56.444265 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c0063212-02ca-4269-b037-683e09eecac3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:56.444729 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c0063212-02ca-4269-b037-683e09eecac3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:56.452941 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c0063212-02ca-4269-b037-683e09eecac3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:56.453393 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c0063212-02ca-4269-b037-683e09eecac3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:56.454303 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c0063212-02ca-4269-b037-683e09eecac3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:56.455032 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c0063212-02ca-4269-b037-683e09eecac3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:56.589657 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c0063212-02ca-4269-b037-683e09eecac3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:56.592051 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=95 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:47:56.598883 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c0063212-02ca-4269-b037-683e09eecac3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1363 microversion: 2.1 time: 0.158503 Jul 01 16:47:56.599676 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 438/880] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:56 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:47:57.616548 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2aae482f-f45d-467b-a5a1-eb48f6c4514f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:57.617241 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2aae482f-f45d-467b-a5a1-eb48f6c4514f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:57.619720 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:47:57.626379 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2aae482f-f45d-467b-a5a1-eb48f6c4514f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:57.626853 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2aae482f-f45d-467b-a5a1-eb48f6c4514f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:57.627635 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2aae482f-f45d-467b-a5a1-eb48f6c4514f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:57.628067 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2aae482f-f45d-467b-a5a1-eb48f6c4514f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:57.769358 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2aae482f-f45d-467b-a5a1-eb48f6c4514f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:57.776785 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2aae482f-f45d-467b-a5a1-eb48f6c4514f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1363 microversion: 2.1 time: 0.164587 Jul 01 16:47:57.777340 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 443/881] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:57 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:58.595527 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-efb92a8e-ea9d-4e75-8730-650c1f14ccb5 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1133953491", "imageRef": "42a4b1a9-dea6-4c87-a2c1-328b9c0c8558", "flavorRef": "452"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:47:58.601270 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:47:58.649621 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-efb92a8e-ea9d-4e75-8730-650c1f14ccb5 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] validate_networks() for None {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 16:47:58.795083 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8da30f4f-8028-4576-8206-027f63bd50e4 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:58.795753 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8da30f4f-8028-4576-8206-027f63bd50e4 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:58.803669 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8da30f4f-8028-4576-8206-027f63bd50e4 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:58.804111 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8da30f4f-8028-4576-8206-027f63bd50e4 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:58.804881 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8da30f4f-8028-4576-8206-027f63bd50e4 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:58.805315 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8da30f4f-8028-4576-8206-027f63bd50e4 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:58.966458 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-efb92a8e-ea9d-4e75-8730-650c1f14ccb5 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 16:47:58.966894 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-efb92a8e-ea9d-4e75-8730-650c1f14ccb5 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 16:47:58.968072 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-efb92a8e-ea9d-4e75-8730-650c1f14ccb5 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 16:47:58.968072 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-efb92a8e-ea9d-4e75-8730-650c1f14ccb5 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 16:47:58.968393 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-efb92a8e-ea9d-4e75-8730-650c1f14ccb5 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 16:47:58.980202 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-efb92a8e-ea9d-4e75-8730-650c1f14ccb5 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:58.980850 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-efb92a8e-ea9d-4e75-8730-650c1f14ccb5 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:58.981719 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-efb92a8e-ea9d-4e75-8730-650c1f14ccb5 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:47:58.982292 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-efb92a8e-ea9d-4e75-8730-650c1f14ccb5 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:47:59.010248 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-efb92a8e-ea9d-4e75-8730-650c1f14ccb5 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Getting quotas for project bec339eeee9c43bb8126fe9dd12173cb. Resources: {'ram', 'cores', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:47:59.017136 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-efb92a8e-ea9d-4e75-8730-650c1f14ccb5 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Getting quotas for user 3fe7a1f541e44b44bfddb4b33cae144b and project bec339eeee9c43bb8126fe9dd12173cb. Resources: {'ram', 'cores', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:47:59.032500 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-efb92a8e-ea9d-4e75-8730-650c1f14ccb5 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 16:47:59.035105 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-efb92a8e-ea9d-4e75-8730-650c1f14ccb5 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] [instance: 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42a4b1a9-dea6-4c87-a2c1-328b9c0c8558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 16:47:59.081215 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-efb92a8e-ea9d-4e75-8730-650c1f14ccb5 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.489604 Jul 01 16:47:59.082431 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 439/882] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 1 16:47:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 16:47:59.092910 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-7b52c77e-6bd4-476c-8654-b5431f6d225e tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:47:59.093804 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-7b52c77e-6bd4-476c-8654-b5431f6d225e tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] [instance: 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:47:59.168478 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7b52c77e-6bd4-476c-8654-b5431f6d225e tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe7a1f541e44b44bfddb4b33cae144b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec339eeee9c43bb8126fe9dd12173cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:59.180151 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-7b52c77e-6bd4-476c-8654-b5431f6d225e tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] 10.222.0.57 "GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b" status: 200 len: 1215 microversion: 2.1 time: 0.091062 Jul 01 16:47:59.180850 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 440/883] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:59 2022] GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:47:59.182752 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8da30f4f-8028-4576-8206-027f63bd50e4 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:47:59.196617 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8da30f4f-8028-4576-8206-027f63bd50e4 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1363 microversion: 2.1 time: 0.405368 Jul 01 16:47:59.197196 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 444/884] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:47:58 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1363 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:48:00.197522 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8e699103-b3ae-4156-87e8-d3450892cde4 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:00.198362 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8e699103-b3ae-4156-87e8-d3450892cde4 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] [instance: 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:00.205052 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8e699103-b3ae-4156-87e8-d3450892cde4 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:00.206019 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8e699103-b3ae-4156-87e8-d3450892cde4 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:00.207051 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8e699103-b3ae-4156-87e8-d3450892cde4 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:00.207807 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8e699103-b3ae-4156-87e8-d3450892cde4 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:00.223433 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-314c90f1-364f-482c-99e4-048460349bb3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:00.224838 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-314c90f1-364f-482c-99e4-048460349bb3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:00.234968 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-314c90f1-364f-482c-99e4-048460349bb3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:00.237560 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-314c90f1-364f-482c-99e4-048460349bb3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:00.239857 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-314c90f1-364f-482c-99e4-048460349bb3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:00.240754 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-314c90f1-364f-482c-99e4-048460349bb3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:00.303911 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8e699103-b3ae-4156-87e8-d3450892cde4 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe7a1f541e44b44bfddb4b33cae144b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec339eeee9c43bb8126fe9dd12173cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:00.311589 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8e699103-b3ae-4156-87e8-d3450892cde4 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] 10.222.0.57 "GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b" status: 200 len: 1285 microversion: 2.1 time: 0.118337 Jul 01 16:48:00.312476 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 441/885] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:00 2022] GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b => generated 1285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:48:00.400917 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-314c90f1-364f-482c-99e4-048460349bb3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:00.409487 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-314c90f1-364f-482c-99e4-048460349bb3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1363 microversion: 2.1 time: 0.192904 Jul 01 16:48:00.410074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 445/886] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:00 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:48:00.456310 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-59637d5f-c76a-4693-8a49-3981af2e9db1 req-30b5d8e2-0801-47bf-b4da-ed72cb421ccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c54f9e-6923-4f5c-a7de-be304f3587dc", "name": "network-vif-plugged", "status": "completed", "tag": "15751548-66ba-4e21-a18e-20e6858b091e"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:48:00.465398 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-59637d5f-c76a-4693-8a49-3981af2e9db1 req-30b5d8e2-0801-47bf-b4da-ed72cb421ccb service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:00.465772 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-59637d5f-c76a-4693-8a49-3981af2e9db1 req-30b5d8e2-0801-47bf-b4da-ed72cb421ccb service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:00.479649 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-59637d5f-c76a-4693-8a49-3981af2e9db1 req-30b5d8e2-0801-47bf-b4da-ed72cb421ccb service nova] Creating event network-vif-plugged:15751548-66ba-4e21-a18e-20e6858b091e for instance f6c54f9e-6923-4f5c-a7de-be304f3587dc on hv-cinder-79760 Jul 01 16:48:00.487198 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-59637d5f-c76a-4693-8a49-3981af2e9db1 req-30b5d8e2-0801-47bf-b4da-ed72cb421ccb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035446 Jul 01 16:48:00.488119 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 442/887] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:48:01.330256 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e586568f-49c4-4615-8e6e-e0a504b2c08c tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:01.330830 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e586568f-49c4-4615-8e6e-e0a504b2c08c tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] [instance: 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:01.337494 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e586568f-49c4-4615-8e6e-e0a504b2c08c tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:01.337963 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e586568f-49c4-4615-8e6e-e0a504b2c08c tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:01.338790 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e586568f-49c4-4615-8e6e-e0a504b2c08c tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:01.339217 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e586568f-49c4-4615-8e6e-e0a504b2c08c tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:01.428757 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1d894aeb-8fd6-4ae3-80a7-d98260f2db5b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:01.429765 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1d894aeb-8fd6-4ae3-80a7-d98260f2db5b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:01.436154 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1d894aeb-8fd6-4ae3-80a7-d98260f2db5b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:01.436689 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1d894aeb-8fd6-4ae3-80a7-d98260f2db5b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:01.437574 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1d894aeb-8fd6-4ae3-80a7-d98260f2db5b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:01.438085 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1d894aeb-8fd6-4ae3-80a7-d98260f2db5b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:01.603279 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e586568f-49c4-4615-8e6e-e0a504b2c08c tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe7a1f541e44b44bfddb4b33cae144b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec339eeee9c43bb8126fe9dd12173cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:01.611192 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e586568f-49c4-4615-8e6e-e0a504b2c08c tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] 10.222.0.57 "GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b" status: 200 len: 1315 microversion: 2.1 time: 0.285837 Jul 01 16:48:01.611963 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 446/888] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:01 2022] GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:48:01.691821 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-1d894aeb-8fd6-4ae3-80a7-d98260f2db5b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:01.700484 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1d894aeb-8fd6-4ae3-80a7-d98260f2db5b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1363 microversion: 2.1 time: 0.276982 Jul 01 16:48:01.711164 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 443/889] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:01 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:48:01.928450 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-d0d40907-dfae-4b2a-833b-5ddb6ebb0adc req-244077ba-ff87-4642-a7bb-0275f8d1c656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b", "tag": "b9db982e-a7da-43fa-99cf-72590182244a"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:48:01.937163 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-d0d40907-dfae-4b2a-833b-5ddb6ebb0adc req-244077ba-ff87-4642-a7bb-0275f8d1c656 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:01.937865 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-d0d40907-dfae-4b2a-833b-5ddb6ebb0adc req-244077ba-ff87-4642-a7bb-0275f8d1c656 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:01.950904 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-d0d40907-dfae-4b2a-833b-5ddb6ebb0adc req-244077ba-ff87-4642-a7bb-0275f8d1c656 service nova] Creating event network-changed:b9db982e-a7da-43fa-99cf-72590182244a for instance 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b on hv-cinder-79760 Jul 01 16:48:01.957368 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-d0d40907-dfae-4b2a-833b-5ddb6ebb0adc req-244077ba-ff87-4642-a7bb-0275f8d1c656 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032827 Jul 01 16:48:01.957968 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 447/890] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:48:02.629800 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ad38c20d-1ae9-413a-8586-3fe6fa5a7113 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:02.630477 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ad38c20d-1ae9-413a-8586-3fe6fa5a7113 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] [instance: 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:02.638000 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ad38c20d-1ae9-413a-8586-3fe6fa5a7113 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:02.638587 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ad38c20d-1ae9-413a-8586-3fe6fa5a7113 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:02.639897 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ad38c20d-1ae9-413a-8586-3fe6fa5a7113 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:02.640544 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ad38c20d-1ae9-413a-8586-3fe6fa5a7113 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:02.714773 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:48:02.715456 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=10 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:48:02.719738 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ef24124c-59fe-42b8-9464-877f1799da31 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:02.720582 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ef24124c-59fe-42b8-9464-877f1799da31 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:02.728548 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ef24124c-59fe-42b8-9464-877f1799da31 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:02.729001 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ef24124c-59fe-42b8-9464-877f1799da31 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:02.729779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ef24124c-59fe-42b8-9464-877f1799da31 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:02.730302 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ef24124c-59fe-42b8-9464-877f1799da31 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:02.955738 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ad38c20d-1ae9-413a-8586-3fe6fa5a7113 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe7a1f541e44b44bfddb4b33cae144b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec339eeee9c43bb8126fe9dd12173cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:02.965396 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ad38c20d-1ae9-413a-8586-3fe6fa5a7113 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] 10.222.0.57 "GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b" status: 200 len: 1315 microversion: 2.1 time: 0.341083 Jul 01 16:48:02.966842 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 444/891] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:02 2022] GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:48:02.980342 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ef24124c-59fe-42b8-9464-877f1799da31 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:02.988418 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ef24124c-59fe-42b8-9464-877f1799da31 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1549 microversion: 2.1 time: 0.275131 Jul 01 16:48:02.989153 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 448/892] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:02 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1549 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:48:03.005438 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-84d05963-6c00-4db1-aa35-7f1557741bac tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:03.005937 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-84d05963-6c00-4db1-aa35-7f1557741bac tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:03.012263 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-84d05963-6c00-4db1-aa35-7f1557741bac tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:03.012782 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-84d05963-6c00-4db1-aa35-7f1557741bac tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:03.013575 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-84d05963-6c00-4db1-aa35-7f1557741bac tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:03.014018 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-84d05963-6c00-4db1-aa35-7f1557741bac tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:03.110434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-84d05963-6c00-4db1-aa35-7f1557741bac tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109373 Jul 01 16:48:03.112981 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 445/893] 10.222.0.57 () {58 vars in 1274 bytes} [Fri Jul 1 16:48:02 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:48:03.983966 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f09bbcd6-2c12-40a9-8f91-6f8057f170ee tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:03.984801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f09bbcd6-2c12-40a9-8f91-6f8057f170ee tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] [instance: 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:03.991875 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f09bbcd6-2c12-40a9-8f91-6f8057f170ee tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:03.992439 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f09bbcd6-2c12-40a9-8f91-6f8057f170ee tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:03.993208 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f09bbcd6-2c12-40a9-8f91-6f8057f170ee tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:03.993644 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f09bbcd6-2c12-40a9-8f91-6f8057f170ee tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:04.253117 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f09bbcd6-2c12-40a9-8f91-6f8057f170ee tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe7a1f541e44b44bfddb4b33cae144b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec339eeee9c43bb8126fe9dd12173cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:04.260572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f09bbcd6-2c12-40a9-8f91-6f8057f170ee tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] 10.222.0.57 "GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b" status: 200 len: 1315 microversion: 2.1 time: 0.280564 Jul 01 16:48:04.261137 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 449/894] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:03 2022] GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:48:04.445395 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-b0840e02-d9e0-42e3-872c-50f9fd481d56 req-c926c091-38d8-49b0-b9e0-52c748620baa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6c54f9e-6923-4f5c-a7de-be304f3587dc", "tag": "15751548-66ba-4e21-a18e-20e6858b091e"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:48:04.453821 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-b0840e02-d9e0-42e3-872c-50f9fd481d56 req-c926c091-38d8-49b0-b9e0-52c748620baa service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:04.454391 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-b0840e02-d9e0-42e3-872c-50f9fd481d56 req-c926c091-38d8-49b0-b9e0-52c748620baa service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:04.466001 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-b0840e02-d9e0-42e3-872c-50f9fd481d56 req-c926c091-38d8-49b0-b9e0-52c748620baa service nova] Creating event network-changed:15751548-66ba-4e21-a18e-20e6858b091e for instance f6c54f9e-6923-4f5c-a7de-be304f3587dc on hv-cinder-79760 Jul 01 16:48:04.471173 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-b0840e02-d9e0-42e3-872c-50f9fd481d56 req-c926c091-38d8-49b0-b9e0-52c748620baa service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029900 Jul 01 16:48:04.472076 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 446/895] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:48:05.276971 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-60550631-7122-4f9f-909e-ba593bb61979 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:05.277600 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-60550631-7122-4f9f-909e-ba593bb61979 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] [instance: 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:05.285260 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-60550631-7122-4f9f-909e-ba593bb61979 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:05.285703 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-60550631-7122-4f9f-909e-ba593bb61979 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:05.286499 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-60550631-7122-4f9f-909e-ba593bb61979 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:05.286932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-60550631-7122-4f9f-909e-ba593bb61979 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:05.426449 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-60550631-7122-4f9f-909e-ba593bb61979 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe7a1f541e44b44bfddb4b33cae144b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec339eeee9c43bb8126fe9dd12173cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:05.433903 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-60550631-7122-4f9f-909e-ba593bb61979 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] 10.222.0.57 "GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b" status: 200 len: 1315 microversion: 2.1 time: 0.160742 Jul 01 16:48:05.434521 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 450/896] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:05 2022] GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:48:06.451977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0c1aaaab-25b5-43e5-8452-34c106bd7f50 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:06.452740 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0c1aaaab-25b5-43e5-8452-34c106bd7f50 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] [instance: 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:06.460587 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0c1aaaab-25b5-43e5-8452-34c106bd7f50 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:06.461040 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0c1aaaab-25b5-43e5-8452-34c106bd7f50 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:06.461881 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0c1aaaab-25b5-43e5-8452-34c106bd7f50 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:06.462329 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0c1aaaab-25b5-43e5-8452-34c106bd7f50 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:06.597043 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0c1aaaab-25b5-43e5-8452-34c106bd7f50 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe7a1f541e44b44bfddb4b33cae144b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec339eeee9c43bb8126fe9dd12173cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:06.604565 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0c1aaaab-25b5-43e5-8452-34c106bd7f50 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] 10.222.0.57 "GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b" status: 200 len: 1315 microversion: 2.1 time: 0.157012 Jul 01 16:48:06.605120 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 447/897] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:06 2022] GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:48:07.622629 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3bea8be5-159c-4b10-90e2-1d4a7bf2840e tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:07.623244 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3bea8be5-159c-4b10-90e2-1d4a7bf2840e tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] [instance: 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:07.629384 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3bea8be5-159c-4b10-90e2-1d4a7bf2840e tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:07.629872 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3bea8be5-159c-4b10-90e2-1d4a7bf2840e tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:07.630842 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3bea8be5-159c-4b10-90e2-1d4a7bf2840e tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:07.631159 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3bea8be5-159c-4b10-90e2-1d4a7bf2840e tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:07.763867 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3bea8be5-159c-4b10-90e2-1d4a7bf2840e tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe7a1f541e44b44bfddb4b33cae144b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec339eeee9c43bb8126fe9dd12173cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:07.772218 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3bea8be5-159c-4b10-90e2-1d4a7bf2840e tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] 10.222.0.57 "GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b" status: 200 len: 1315 microversion: 2.1 time: 0.153758 Jul 01 16:48:07.772788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 451/898] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:07 2022] GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:48:08.483853 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-a7f13fb0-a693-473c-b3d1-6d791ca75619 req-d8a29c3f-a706-45e7-a012-c7887e883b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b", "name": "network-vif-plugged", "status": "completed", "tag": "b9db982e-a7da-43fa-99cf-72590182244a"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:48:08.494226 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-a7f13fb0-a693-473c-b3d1-6d791ca75619 req-d8a29c3f-a706-45e7-a012-c7887e883b1d service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:08.494709 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-a7f13fb0-a693-473c-b3d1-6d791ca75619 req-d8a29c3f-a706-45e7-a012-c7887e883b1d service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:08.506951 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-a7f13fb0-a693-473c-b3d1-6d791ca75619 req-d8a29c3f-a706-45e7-a012-c7887e883b1d service nova] Creating event network-vif-plugged:b9db982e-a7da-43fa-99cf-72590182244a for instance 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b on hv-cinder-79760 Jul 01 16:48:08.511695 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-a7f13fb0-a693-473c-b3d1-6d791ca75619 req-d8a29c3f-a706-45e7-a012-c7887e883b1d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031552 Jul 01 16:48:08.512478 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 448/899] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:48:08.789510 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6be83fb1-d25e-4629-8219-e2ed400b455b tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:08.790123 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6be83fb1-d25e-4629-8219-e2ed400b455b tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] [instance: 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:08.796564 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6be83fb1-d25e-4629-8219-e2ed400b455b tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:08.797006 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6be83fb1-d25e-4629-8219-e2ed400b455b tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:08.797761 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6be83fb1-d25e-4629-8219-e2ed400b455b tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:08.799044 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6be83fb1-d25e-4629-8219-e2ed400b455b tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:08.931362 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6be83fb1-d25e-4629-8219-e2ed400b455b tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe7a1f541e44b44bfddb4b33cae144b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec339eeee9c43bb8126fe9dd12173cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:08.938679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6be83fb1-d25e-4629-8219-e2ed400b455b tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] 10.222.0.57 "GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b" status: 200 len: 1315 microversion: 2.1 time: 0.153006 Jul 01 16:48:08.939952 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 452/900] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:08 2022] GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:48:09.957376 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8885b0a8-2fa4-4121-a1a7-c34ea4ba739f tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:09.957990 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8885b0a8-2fa4-4121-a1a7-c34ea4ba739f tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] [instance: 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:09.959954 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:48:09.960637 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=10 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:48:09.967128 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8885b0a8-2fa4-4121-a1a7-c34ea4ba739f tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:09.967576 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8885b0a8-2fa4-4121-a1a7-c34ea4ba739f tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:09.968346 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8885b0a8-2fa4-4121-a1a7-c34ea4ba739f tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:09.968781 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8885b0a8-2fa4-4121-a1a7-c34ea4ba739f tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:10.112193 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8885b0a8-2fa4-4121-a1a7-c34ea4ba739f tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe7a1f541e44b44bfddb4b33cae144b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec339eeee9c43bb8126fe9dd12173cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:10.119617 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8885b0a8-2fa4-4121-a1a7-c34ea4ba739f tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] 10.222.0.57 "GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b" status: 200 len: 1315 microversion: 2.1 time: 0.167692 Jul 01 16:48:10.120188 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 449/901] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:09 2022] GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:48:11.136829 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-99129032-8236-4809-831c-debafb8ace6f tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:11.137440 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-99129032-8236-4809-831c-debafb8ace6f tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] [instance: 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:11.144722 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-99129032-8236-4809-831c-debafb8ace6f tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:11.145169 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-99129032-8236-4809-831c-debafb8ace6f tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:11.145969 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-99129032-8236-4809-831c-debafb8ace6f tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:11.146439 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-99129032-8236-4809-831c-debafb8ace6f tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:11.273865 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-99129032-8236-4809-831c-debafb8ace6f tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe7a1f541e44b44bfddb4b33cae144b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec339eeee9c43bb8126fe9dd12173cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:11.281331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-99129032-8236-4809-831c-debafb8ace6f tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] 10.222.0.57 "GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b" status: 200 len: 1465 microversion: 2.1 time: 0.148428 Jul 01 16:48:11.281894 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 453/902] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:11 2022] GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b => generated 1465 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:48:11.320829 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-785880ce-6fa7-4079-bd3b-b8ffaee39236 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:11.321328 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-785880ce-6fa7-4079-bd3b-b8ffaee39236 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] [instance: 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:11.327918 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-785880ce-6fa7-4079-bd3b-b8ffaee39236 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:11.328317 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-785880ce-6fa7-4079-bd3b-b8ffaee39236 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:11.329088 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-785880ce-6fa7-4079-bd3b-b8ffaee39236 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:11.330135 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-785880ce-6fa7-4079-bd3b-b8ffaee39236 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:11.355323 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-785880ce-6fa7-4079-bd3b-b8ffaee39236 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] [instance: 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 16:48:11.431325 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-785880ce-6fa7-4079-bd3b-b8ffaee39236 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b" status: 204 len: 0 microversion: 2.1 time: 0.114136 Jul 01 16:48:11.431919 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 450/903] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:48:11 2022] DELETE /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 16:48:11.442847 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c1f0d249-4816-4bdd-aedd-878169c27513 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:11.443579 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c1f0d249-4816-4bdd-aedd-878169c27513 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] [instance: 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:11.449690 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c1f0d249-4816-4bdd-aedd-878169c27513 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:11.450142 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c1f0d249-4816-4bdd-aedd-878169c27513 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:11.450951 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c1f0d249-4816-4bdd-aedd-878169c27513 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:11.451394 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c1f0d249-4816-4bdd-aedd-878169c27513 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:11.586721 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c1f0d249-4816-4bdd-aedd-878169c27513 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe7a1f541e44b44bfddb4b33cae144b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec339eeee9c43bb8126fe9dd12173cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:11.594109 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c1f0d249-4816-4bdd-aedd-878169c27513 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] 10.222.0.57 "GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b" status: 200 len: 1471 microversion: 2.1 time: 0.157147 Jul 01 16:48:11.594696 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 454/904] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:11 2022] GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:48:12.614995 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-84b738e9-5534-4771-9dcd-87441a2c8446 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:12.615692 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-84b738e9-5534-4771-9dcd-87441a2c8446 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] [instance: 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:12.622274 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-84b738e9-5534-4771-9dcd-87441a2c8446 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:12.622768 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-84b738e9-5534-4771-9dcd-87441a2c8446 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:12.623536 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-84b738e9-5534-4771-9dcd-87441a2c8446 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:12.623972 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-84b738e9-5534-4771-9dcd-87441a2c8446 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:12.763412 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-84b738e9-5534-4771-9dcd-87441a2c8446 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe7a1f541e44b44bfddb4b33cae144b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec339eeee9c43bb8126fe9dd12173cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:12.771000 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-84b738e9-5534-4771-9dcd-87441a2c8446 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] 10.222.0.57 "GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b" status: 200 len: 1471 microversion: 2.1 time: 0.161107 Jul 01 16:48:12.771575 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 451/905] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:12 2022] GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:48:13.559252 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-fee56715-719d-4f0f-af0b-a468cd6aa5f4 req-cdf56779-d07d-4f3b-8bc5-363cf0059b5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b", "name": "network-vif-deleted", "tag": "b9db982e-a7da-43fa-99cf-72590182244a"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:48:13.569474 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-fee56715-719d-4f0f-af0b-a468cd6aa5f4 req-cdf56779-d07d-4f3b-8bc5-363cf0059b5c service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:13.569474 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-fee56715-719d-4f0f-af0b-a468cd6aa5f4 req-cdf56779-d07d-4f3b-8bc5-363cf0059b5c service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:13.584921 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-fee56715-719d-4f0f-af0b-a468cd6aa5f4 req-cdf56779-d07d-4f3b-8bc5-363cf0059b5c service nova] Creating event network-vif-deleted:b9db982e-a7da-43fa-99cf-72590182244a for instance 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b on hv-cinder-79760 Jul 01 16:48:13.591111 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-fee56715-719d-4f0f-af0b-a468cd6aa5f4 req-cdf56779-d07d-4f3b-8bc5-363cf0059b5c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035884 Jul 01 16:48:13.591900 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 455/906] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:48:13.788541 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6476a7ad-cccb-4573-babb-da4ce5c6fa4b tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:13.789152 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6476a7ad-cccb-4573-babb-da4ce5c6fa4b tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] [instance: 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:13.795604 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6476a7ad-cccb-4573-babb-da4ce5c6fa4b tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:13.796054 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6476a7ad-cccb-4573-babb-da4ce5c6fa4b tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:13.796845 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6476a7ad-cccb-4573-babb-da4ce5c6fa4b tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:13.797284 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6476a7ad-cccb-4573-babb-da4ce5c6fa4b tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:13.828181 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6476a7ad-cccb-4573-babb-da4ce5c6fa4b tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:13.828625 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6476a7ad-cccb-4573-babb-da4ce5c6fa4b tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:13.829820 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-6476a7ad-cccb-4573-babb-da4ce5c6fa4b tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lazy-loading 'fault' on Instance uuid 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:48:13.873807 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6476a7ad-cccb-4573-babb-da4ce5c6fa4b tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe7a1f541e44b44bfddb4b33cae144b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec339eeee9c43bb8126fe9dd12173cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:13.881868 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6476a7ad-cccb-4573-babb-da4ce5c6fa4b tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] 10.222.0.57 "GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b" status: 200 len: 1305 microversion: 2.1 time: 0.097543 Jul 01 16:48:13.882441 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 452/907] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:13 2022] GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:48:14.900071 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-96dad2f9-761f-4ced-9b1f-ebe8138b1558 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:14.900769 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-96dad2f9-761f-4ced-9b1f-ebe8138b1558 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] [instance: 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:14.906992 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-96dad2f9-761f-4ced-9b1f-ebe8138b1558 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:14.907441 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-96dad2f9-761f-4ced-9b1f-ebe8138b1558 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:14.908194 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-96dad2f9-761f-4ced-9b1f-ebe8138b1558 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:14.909275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-96dad2f9-761f-4ced-9b1f-ebe8138b1558 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:14.922276 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-96dad2f9-761f-4ced-9b1f-ebe8138b1558 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] HTTP exception thrown: Instance 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b could not be found. Jul 01 16:48:14.924011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-96dad2f9-761f-4ced-9b1f-ebe8138b1558 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Request method failure captured: Jul 01 16:48:14.924011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b HTTP/1.1 Jul 01 16:48:14.924011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:48:14.924011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:48:14.924011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:48:14.924011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:48:14.924011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:48:14.924011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:48:14.924011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:48:14.924011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:48:14.924011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyU9NNSbPDo7aFLcGkExj5NBLlhUl7S_eI8Ap5BvoIDk8DEZGozRGp4WKYFKezVr-UN0y2BAj-zSWiqZiuzuiPGcRh50b-ep7TOl3i6F9UB6gvQzsT454PamsInIZ8JNwKyW_8MytcWrE37qOqYoLfCW_A5mV7kELUiHEVscSh-VYls Jul 01 16:48:14.924011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:48:14.924011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:48:14.924011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:48:14.924011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:48:14.924011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:48:14.924011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:48:14.924011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: bec339eeee9c43bb8126fe9dd12173cb Jul 01 16:48:14.924011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-VolumesNegativeTest-2053657634 Jul 01 16:48:14.924011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:48:14.924011 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:48:14.925719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bec339eeee9c43bb8126fe9dd12173cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bec339eeee9c43bb8126fe9dd12173cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bec339eeee9c43bb8126fe9dd12173cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bec339eeee9c43bb8126fe9dd12173cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:48:14.925719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-VolumesNegativeTest-2053657634 Jul 01 16:48:14.925719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: bec339eeee9c43bb8126fe9dd12173cb Jul 01 16:48:14.925719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-VolumesNegativeTest-2053657634 Jul 01 16:48:14.925719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-VolumesNegativeTest-2053657634-project Jul 01 16:48:14.925719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:48:14.925719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:48:14.925719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: 3fe7a1f541e44b44bfddb4b33cae144b Jul 01 16:48:14.925719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-VolumesNegativeTest-2053657634-project Jul 01 16:48:14.925719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:48:14.925719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b could not be found. Jul 01 16:48:14.925719 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': '5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b'} Jul 01 16:48:14.926753 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:48:14.926753 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:48:14.926753 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:48:14.926753 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:48:14.926753 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:48:14.926753 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:48:14.926753 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:48:14.926753 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:48:14.926753 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:48:14.926753 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:48:14.926753 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b could not be found. Jul 01 16:48:14.926753 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:48:14.926753 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:48:14.926753 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:48:14.926753 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:48:14.926753 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:48:14.926753 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:48:14.926753 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:48:14.926753 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:48:14.926753 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:48:14.928331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:48:14.928331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:48:14.928331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:48:14.928331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:48:14.928331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:48:14.928331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:48:14.928331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:48:14.928331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b could not be found. Jul 01 16:48:14.928331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:48:14.928331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:48:14.928331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:48:14.928331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:48:14.928331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:48:14.928331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:48:14.928331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:48:14.928331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:48:14.928331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b could not be found. Jul 01 16:48:14.928331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:48:14.930082 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-96dad2f9-761f-4ced-9b1f-ebe8138b1558 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] Returning 404 to user: Instance 5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:48:14.930082 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-96dad2f9-761f-4ced-9b1f-ebe8138b1558 tempest-VolumesNegativeTest-2053657634 tempest-VolumesNegativeTest-2053657634-project] 10.222.0.57 "GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b" status: 404 len: 111 microversion: 2.1 time: 0.030168 Jul 01 16:48:14.930082 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 456/908] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:14 2022] GET /compute/v2.1/servers/5a044aa2-e65d-4e16-9ac5-c6a8b3a54c4b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:48:25.015451 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-50d9c5ff-1e68-46ed-813c-716d5b234124 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:25.016526 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-50d9c5ff-1e68-46ed-813c-716d5b234124 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:25.017952 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-6d7a97ba-4d60-49fb-b506-e8ec27f23be0 req-6c8edc52-ef6a-4a70-ba6e-5e02ba7261ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "602a9841-5b03-4f60-b3be-7c4efe7cd9ef", "tag": "dfaabde7-2cdd-46ea-9860-694b36767f5e"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:48:25.020583 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:48:25.021234 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:48:25.024773 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=27 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:48:25.025482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=88 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:48:25.025756 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-50d9c5ff-1e68-46ed-813c-716d5b234124 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:25.026466 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-50d9c5ff-1e68-46ed-813c-716d5b234124 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:25.027260 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-50d9c5ff-1e68-46ed-813c-716d5b234124 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:25.027875 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-50d9c5ff-1e68-46ed-813c-716d5b234124 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:25.035877 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-6d7a97ba-4d60-49fb-b506-e8ec27f23be0 req-6c8edc52-ef6a-4a70-ba6e-5e02ba7261ac service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:25.036182 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-6d7a97ba-4d60-49fb-b506-e8ec27f23be0 req-6c8edc52-ef6a-4a70-ba6e-5e02ba7261ac service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:25.051849 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-6d7a97ba-4d60-49fb-b506-e8ec27f23be0 req-6c8edc52-ef6a-4a70-ba6e-5e02ba7261ac service nova] Creating event network-changed:dfaabde7-2cdd-46ea-9860-694b36767f5e for instance 602a9841-5b03-4f60-b3be-7c4efe7cd9ef on hv-cinder-79760 Jul 01 16:48:25.055792 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-50d9c5ff-1e68-46ed-813c-716d5b234124 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 16:48:25.064345 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-6d7a97ba-4d60-49fb-b506-e8ec27f23be0 req-6c8edc52-ef6a-4a70-ba6e-5e02ba7261ac service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050221 Jul 01 16:48:25.066218 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 457/909] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:48:25.145033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-50d9c5ff-1e68-46ed-813c-716d5b234124 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "DELETE /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 204 len: 0 microversion: 2.1 time: 0.133220 Jul 01 16:48:25.145849 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 453/910] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:48:25 2022] DELETE /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 16:48:25.155931 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8b106052-61d0-4cae-8a51-d41f51804d04 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:25.156910 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8b106052-61d0-4cae-8a51-d41f51804d04 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:25.164936 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8b106052-61d0-4cae-8a51-d41f51804d04 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:25.166013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8b106052-61d0-4cae-8a51-d41f51804d04 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:25.166188 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8b106052-61d0-4cae-8a51-d41f51804d04 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:25.166667 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8b106052-61d0-4cae-8a51-d41f51804d04 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:25.308525 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8b106052-61d0-4cae-8a51-d41f51804d04 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:25.317380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8b106052-61d0-4cae-8a51-d41f51804d04 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1569 microversion: 2.1 time: 0.166732 Jul 01 16:48:25.317953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 458/911] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:25 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:48:26.335522 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-deecc881-586b-4406-ac44-0b51b0b4e2a1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:26.336226 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-deecc881-586b-4406-ac44-0b51b0b4e2a1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:26.342719 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-deecc881-586b-4406-ac44-0b51b0b4e2a1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:26.343171 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-deecc881-586b-4406-ac44-0b51b0b4e2a1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:26.343971 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-deecc881-586b-4406-ac44-0b51b0b4e2a1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:26.344416 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-deecc881-586b-4406-ac44-0b51b0b4e2a1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:26.542797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-deecc881-586b-4406-ac44-0b51b0b4e2a1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:26.550235 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-deecc881-586b-4406-ac44-0b51b0b4e2a1 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1569 microversion: 2.1 time: 0.219508 Jul 01 16:48:26.552029 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 454/912] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:26 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:48:27.570002 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-186b36fd-28b3-4034-8de0-a2474ccad4fe tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:27.571227 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-186b36fd-28b3-4034-8de0-a2474ccad4fe tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:27.577533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-186b36fd-28b3-4034-8de0-a2474ccad4fe tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:27.577979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-186b36fd-28b3-4034-8de0-a2474ccad4fe tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:27.578778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-186b36fd-28b3-4034-8de0-a2474ccad4fe tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:27.579207 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-186b36fd-28b3-4034-8de0-a2474ccad4fe tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:27.604025 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-038f47f3-150d-4522-9478-1d541969701e req-97e4fecd-5093-4526-9de5-73eed73ede53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "602a9841-5b03-4f60-b3be-7c4efe7cd9ef", "name": "network-vif-deleted", "tag": "dfaabde7-2cdd-46ea-9860-694b36767f5e"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:48:27.612780 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-038f47f3-150d-4522-9478-1d541969701e req-97e4fecd-5093-4526-9de5-73eed73ede53 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:27.614140 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-038f47f3-150d-4522-9478-1d541969701e req-97e4fecd-5093-4526-9de5-73eed73ede53 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:27.632475 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-038f47f3-150d-4522-9478-1d541969701e req-97e4fecd-5093-4526-9de5-73eed73ede53 service nova] Creating event network-vif-deleted:dfaabde7-2cdd-46ea-9860-694b36767f5e for instance 602a9841-5b03-4f60-b3be-7c4efe7cd9ef on hv-cinder-79760 Jul 01 16:48:27.640116 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-038f47f3-150d-4522-9478-1d541969701e req-97e4fecd-5093-4526-9de5-73eed73ede53 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039558 Jul 01 16:48:27.640776 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 455/913] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:48:27.648181 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-186b36fd-28b3-4034-8de0-a2474ccad4fe tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b62962ac2a14ae997fb637e80129beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb9237b6e8a4b5ca032f0664d09f28e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:27.655726 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-186b36fd-28b3-4034-8de0-a2474ccad4fe tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 200 len: 1382 microversion: 2.1 time: 0.090427 Jul 01 16:48:27.656289 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 459/914] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:27 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 1382 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:48:28.673434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fcf4b08e-8552-473e-9813-833a7d733342 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:28.674082 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-fcf4b08e-8552-473e-9813-833a7d733342 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] [instance: 602a9841-5b03-4f60-b3be-7c4efe7cd9ef] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:28.681086 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fcf4b08e-8552-473e-9813-833a7d733342 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:28.681538 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fcf4b08e-8552-473e-9813-833a7d733342 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:28.682307 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fcf4b08e-8552-473e-9813-833a7d733342 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:28.682773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fcf4b08e-8552-473e-9813-833a7d733342 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:28.696455 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-fcf4b08e-8552-473e-9813-833a7d733342 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] HTTP exception thrown: Instance 602a9841-5b03-4f60-b3be-7c4efe7cd9ef could not be found. Jul 01 16:48:28.698061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fcf4b08e-8552-473e-9813-833a7d733342 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Request method failure captured: Jul 01 16:48:28.698061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef HTTP/1.1 Jul 01 16:48:28.698061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:48:28.698061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:48:28.698061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:48:28.698061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:48:28.698061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:48:28.698061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:48:28.698061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:48:28.698061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:48:28.698061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyQFDmda1PwAzqkITpqjoVoscMRKcJOMBGUZ55imEVIJjYikSs705bjkNX7nVe938HZI7DD4T-seIEdpIeV4FtJ11VyRxzW3oOVKTDejsMuMeFKuL3-sQxmqy4Nfq5bE6yxzM6xzPavUqbv8Zp9inE0xefKi8cEPEt13a6GAhJUJsuc Jul 01 16:48:28.698061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:48:28.698061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:48:28.698061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:48:28.698061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:48:28.698061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:48:28.698061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:48:28.698061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: 1eb9237b6e8a4b5ca032f0664d09f28e Jul 01 16:48:28.698061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-TestShelveInstance-696776370 Jul 01 16:48:28.698061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:48:28.698061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:48:28.699690 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1eb9237b6e8a4b5ca032f0664d09f28e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1eb9237b6e8a4b5ca032f0664d09f28e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1eb9237b6e8a4b5ca032f0664d09f28e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1eb9237b6e8a4b5ca032f0664d09f28e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:48:28.699690 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-TestShelveInstance-696776370 Jul 01 16:48:28.699690 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 1eb9237b6e8a4b5ca032f0664d09f28e Jul 01 16:48:28.699690 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-TestShelveInstance-696776370 Jul 01 16:48:28.699690 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-TestShelveInstance-696776370-project Jul 01 16:48:28.699690 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:48:28.699690 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:48:28.699690 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: 5b62962ac2a14ae997fb637e80129beb Jul 01 16:48:28.699690 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-TestShelveInstance-696776370-project Jul 01 16:48:28.699690 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: > Jul 01 16:48:28.699690 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Instance 602a9841-5b03-4f60-b3be-7c4efe7cd9ef could not be found. Jul 01 16:48:28.699690 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'id': '602a9841-5b03-4f60-b3be-7c4efe7cd9ef'} Jul 01 16:48:28.700629 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:48:28.700629 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:48:28.700629 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:48:28.700629 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:48:28.700629 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:48:28.700629 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:48:28.700629 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:48:28.700629 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:48:28.700629 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:48:28.700629 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:48:28.700629 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 602a9841-5b03-4f60-b3be-7c4efe7cd9ef could not be found. Jul 01 16:48:28.700629 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:48:28.700629 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:48:28.700629 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:48:28.700629 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:48:28.700629 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:48:28.700629 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:48:28.700629 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:48:28.700629 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:48:28.700629 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:48:28.702072 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:48:28.702072 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:48:28.702072 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:48:28.702072 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:48:28.702072 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:48:28.702072 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:48:28.702072 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:48:28.702072 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 602a9841-5b03-4f60-b3be-7c4efe7cd9ef could not be found. Jul 01 16:48:28.702072 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:48:28.702072 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:48:28.702072 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:48:28.702072 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:48:28.702072 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:48:28.702072 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:48:28.702072 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:48:28.702072 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:48:28.702072 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 602a9841-5b03-4f60-b3be-7c4efe7cd9ef could not be found. Jul 01 16:48:28.702072 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:48:28.703478 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fcf4b08e-8552-473e-9813-833a7d733342 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Returning 404 to user: Instance 602a9841-5b03-4f60-b3be-7c4efe7cd9ef could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:48:28.703478 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fcf4b08e-8552-473e-9813-833a7d733342 tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef" status: 404 len: 111 microversion: 2.1 time: 0.030431 Jul 01 16:48:28.703478 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 456/915] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:28 2022] GET /compute/v2.1/servers/602a9841-5b03-4f60-b3be-7c4efe7cd9ef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:48:29.136316 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8ebf9ae7-a4b0-4dde-8240-1973b643297b tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] Calling method '.version_select at 0x7fa86c3aae50>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:29.155050 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8ebf9ae7-a4b0-4dde-8240-1973b643297b tempest-TestShelveInstance-696776370 tempest-TestShelveInstance-696776370-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1420297892" status: 202 len: 0 microversion: 2.1 time: 0.022428 Jul 01 16:48:29.155630 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 460/916] 10.222.0.57 () {58 vars in 1253 bytes} [Fri Jul 1 16:48:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1420297892 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:48:40.509658 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-75693e47-154f-42d3-ba7d-2c9dc74e9328 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:40.510246 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-75693e47-154f-42d3-ba7d-2c9dc74e9328 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:40.512749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:48:40.513536 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:48:40.520124 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-75693e47-154f-42d3-ba7d-2c9dc74e9328 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:40.520613 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-75693e47-154f-42d3-ba7d-2c9dc74e9328 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:40.521395 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-75693e47-154f-42d3-ba7d-2c9dc74e9328 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:40.521835 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-75693e47-154f-42d3-ba7d-2c9dc74e9328 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:40.549079 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-75693e47-154f-42d3-ba7d-2c9dc74e9328 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc/ips" status: 200 len: 146 microversion: 2.1 time: 0.043328 Jul 01 16:48:40.549648 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 457/917] 10.222.0.57 () {58 vars in 1247 bytes} [Fri Jul 1 16:48:40 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:48:44.034243 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-48fc7f8f-3b75-44be-b981-a96df30e7974 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cd2eedb-1758-435a-a099-78a946febd01"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:48:44.035354 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-48fc7f8f-3b75-44be-b981-a96df30e7974 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:44.038432 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=14 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:48:44.039079 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:48:44.046030 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-48fc7f8f-3b75-44be-b981-a96df30e7974 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:44.046516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-48fc7f8f-3b75-44be-b981-a96df30e7974 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:44.047284 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-48fc7f8f-3b75-44be-b981-a96df30e7974 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:44.047721 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-48fc7f8f-3b75-44be-b981-a96df30e7974 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:44.325733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-48fc7f8f-3b75-44be-b981-a96df30e7974 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "POST /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295382 Jul 01 16:48:44.326513 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 461/918] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 1 16:48:44 2022] POST /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:48:51.840644 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-7858371b-c0ab-40c7-b8c9-23c5124ec009 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:48:51.842668 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:48:51.843307 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=4 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:48:51.849621 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7858371b-c0ab-40c7-b8c9-23c5124ec009 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:51.850945 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7858371b-c0ab-40c7-b8c9-23c5124ec009 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:51.911351 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-7858371b-c0ab-40c7-b8c9-23c5124ec009 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Going to try to stop instance {{(pid=124316) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 01 16:48:51.955122 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-7858371b-c0ab-40c7-b8c9-23c5124ec009 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "POST /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc/action" status: 202 len: 0 microversion: 2.1 time: 0.118303 Jul 01 16:48:51.955817 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 458/919] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 1 16:48:51 2022] POST /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 16:48:51.965975 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d65341b8-2ef3-427b-ae20-f6b75e22d77f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:51.966664 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d65341b8-2ef3-427b-ae20-f6b75e22d77f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:51.973377 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d65341b8-2ef3-427b-ae20-f6b75e22d77f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:51.973924 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d65341b8-2ef3-427b-ae20-f6b75e22d77f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:51.974849 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d65341b8-2ef3-427b-ae20-f6b75e22d77f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:51.975981 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d65341b8-2ef3-427b-ae20-f6b75e22d77f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:52.110697 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d65341b8-2ef3-427b-ae20-f6b75e22d77f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:52.119326 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d65341b8-2ef3-427b-ae20-f6b75e22d77f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1724 microversion: 2.1 time: 0.158325 Jul 01 16:48:52.119887 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 462/920] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:51 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:48:53.137297 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fb99f712-69b1-46ae-b7c0-2441dd2e02a4 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:53.137920 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-fb99f712-69b1-46ae-b7c0-2441dd2e02a4 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:53.144961 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fb99f712-69b1-46ae-b7c0-2441dd2e02a4 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:53.145418 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fb99f712-69b1-46ae-b7c0-2441dd2e02a4 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:53.146256 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fb99f712-69b1-46ae-b7c0-2441dd2e02a4 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:53.146855 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fb99f712-69b1-46ae-b7c0-2441dd2e02a4 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:53.277178 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fb99f712-69b1-46ae-b7c0-2441dd2e02a4 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:53.285379 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fb99f712-69b1-46ae-b7c0-2441dd2e02a4 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1724 microversion: 2.1 time: 0.152996 Jul 01 16:48:53.285941 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 459/921] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:53 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:48:54.303195 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a0f044b9-0fc7-4d47-b076-7dd9e9cd56e7 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:54.303949 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a0f044b9-0fc7-4d47-b076-7dd9e9cd56e7 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:54.310523 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a0f044b9-0fc7-4d47-b076-7dd9e9cd56e7 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:54.310967 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a0f044b9-0fc7-4d47-b076-7dd9e9cd56e7 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:54.311713 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a0f044b9-0fc7-4d47-b076-7dd9e9cd56e7 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:54.312137 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a0f044b9-0fc7-4d47-b076-7dd9e9cd56e7 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:54.447147 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a0f044b9-0fc7-4d47-b076-7dd9e9cd56e7 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:54.455151 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a0f044b9-0fc7-4d47-b076-7dd9e9cd56e7 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1724 microversion: 2.1 time: 0.155746 Jul 01 16:48:54.455724 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 463/922] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:54 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:48:55.473249 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-20e557d8-c89d-47d6-ae0b-c463f723554c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:55.473860 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-20e557d8-c89d-47d6-ae0b-c463f723554c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:55.480381 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-20e557d8-c89d-47d6-ae0b-c463f723554c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:55.480830 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-20e557d8-c89d-47d6-ae0b-c463f723554c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:55.481597 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-20e557d8-c89d-47d6-ae0b-c463f723554c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:55.482029 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-20e557d8-c89d-47d6-ae0b-c463f723554c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:55.612321 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-20e557d8-c89d-47d6-ae0b-c463f723554c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:55.620932 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-20e557d8-c89d-47d6-ae0b-c463f723554c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1724 microversion: 2.1 time: 0.151628 Jul 01 16:48:55.621496 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 460/923] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:55 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:48:56.638323 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b25f6dd5-24dd-4cbb-8519-902d58209042 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:56.638960 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b25f6dd5-24dd-4cbb-8519-902d58209042 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:56.646047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b25f6dd5-24dd-4cbb-8519-902d58209042 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:56.647279 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b25f6dd5-24dd-4cbb-8519-902d58209042 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:56.648082 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b25f6dd5-24dd-4cbb-8519-902d58209042 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:56.648521 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b25f6dd5-24dd-4cbb-8519-902d58209042 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:56.781263 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b25f6dd5-24dd-4cbb-8519-902d58209042 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:56.789385 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b25f6dd5-24dd-4cbb-8519-902d58209042 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1724 microversion: 2.1 time: 0.154894 Jul 01 16:48:56.790035 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 464/924] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:56 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:48:57.807512 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5bbafaf4-8e35-4f10-a1e8-19356272bb76 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:57.808127 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5bbafaf4-8e35-4f10-a1e8-19356272bb76 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:57.814641 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5bbafaf4-8e35-4f10-a1e8-19356272bb76 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:57.815093 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5bbafaf4-8e35-4f10-a1e8-19356272bb76 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:57.815858 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5bbafaf4-8e35-4f10-a1e8-19356272bb76 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:57.816295 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5bbafaf4-8e35-4f10-a1e8-19356272bb76 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:57.946902 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5bbafaf4-8e35-4f10-a1e8-19356272bb76 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:57.954735 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5bbafaf4-8e35-4f10-a1e8-19356272bb76 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1724 microversion: 2.1 time: 0.151990 Jul 01 16:48:57.955289 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 461/925] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:57 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:48:58.972895 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-bd2fc4d2-d035-4318-815c-ef1c06a1e587 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:48:58.973448 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-bd2fc4d2-d035-4318-815c-ef1c06a1e587 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:48:58.980273 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bd2fc4d2-d035-4318-815c-ef1c06a1e587 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:58.980718 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bd2fc4d2-d035-4318-815c-ef1c06a1e587 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:58.981483 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bd2fc4d2-d035-4318-815c-ef1c06a1e587 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:48:58.981917 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bd2fc4d2-d035-4318-815c-ef1c06a1e587 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:48:59.124196 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bd2fc4d2-d035-4318-815c-ef1c06a1e587 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:48:59.133732 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-bd2fc4d2-d035-4318-815c-ef1c06a1e587 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1724 microversion: 2.1 time: 0.164851 Jul 01 16:48:59.134306 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 465/926] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:48:58 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:00.151444 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a336cce1-3b27-4b41-84f5-24d3c0622434 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:00.152091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a336cce1-3b27-4b41-84f5-24d3c0622434 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:00.158579 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a336cce1-3b27-4b41-84f5-24d3c0622434 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:00.159033 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a336cce1-3b27-4b41-84f5-24d3c0622434 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:00.159798 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a336cce1-3b27-4b41-84f5-24d3c0622434 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:00.160237 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a336cce1-3b27-4b41-84f5-24d3c0622434 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:00.288632 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a336cce1-3b27-4b41-84f5-24d3c0622434 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:00.296486 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a336cce1-3b27-4b41-84f5-24d3c0622434 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1724 microversion: 2.1 time: 0.148884 Jul 01 16:49:00.297047 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 462/927] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:00 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:01.313359 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-233e1879-ab9a-421e-b95d-973a721d4fe9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:01.313996 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-233e1879-ab9a-421e-b95d-973a721d4fe9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:01.321026 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-233e1879-ab9a-421e-b95d-973a721d4fe9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:01.321475 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-233e1879-ab9a-421e-b95d-973a721d4fe9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:01.322231 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-233e1879-ab9a-421e-b95d-973a721d4fe9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:01.322696 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-233e1879-ab9a-421e-b95d-973a721d4fe9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:01.452316 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-233e1879-ab9a-421e-b95d-973a721d4fe9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:01.461161 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-233e1879-ab9a-421e-b95d-973a721d4fe9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1724 microversion: 2.1 time: 0.151644 Jul 01 16:49:01.461897 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 466/928] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:01 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:02.479427 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e58c5595-f5d6-43c9-bd19-d3906f31ece9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:02.480042 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e58c5595-f5d6-43c9-bd19-d3906f31ece9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:02.486649 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e58c5595-f5d6-43c9-bd19-d3906f31ece9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:02.487101 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e58c5595-f5d6-43c9-bd19-d3906f31ece9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:02.487865 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e58c5595-f5d6-43c9-bd19-d3906f31ece9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:02.488307 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e58c5595-f5d6-43c9-bd19-d3906f31ece9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:02.884423 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e58c5595-f5d6-43c9-bd19-d3906f31ece9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:02.892392 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e58c5595-f5d6-43c9-bd19-d3906f31ece9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1701 microversion: 2.1 time: 0.416861 Jul 01 16:49:02.892959 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 463/929] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:02 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1701 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:02.909105 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-24754fdd-3d29-4f69-966b-c02b9dea4383 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:49:02.916316 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-24754fdd-3d29-4f69-966b-c02b9dea4383 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:02.916764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-24754fdd-3d29-4f69-966b-c02b9dea4383 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:02.976198 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-24754fdd-3d29-4f69-966b-c02b9dea4383 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Going to try to start instance {{(pid=124317) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 01 16:49:03.018291 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-24754fdd-3d29-4f69-966b-c02b9dea4383 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "POST /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc/action" status: 202 len: 0 microversion: 2.1 time: 0.112777 Jul 01 16:49:03.018917 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 467/930] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 1 16:49:02 2022] POST /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:49:03.027666 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ca1f08bc-f2c7-48f9-ac55-fdc02d6716e0 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:03.028307 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ca1f08bc-f2c7-48f9-ac55-fdc02d6716e0 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:03.034440 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ca1f08bc-f2c7-48f9-ac55-fdc02d6716e0 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:03.034891 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ca1f08bc-f2c7-48f9-ac55-fdc02d6716e0 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:03.035655 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ca1f08bc-f2c7-48f9-ac55-fdc02d6716e0 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:03.036092 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ca1f08bc-f2c7-48f9-ac55-fdc02d6716e0 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:03.174408 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ca1f08bc-f2c7-48f9-ac55-fdc02d6716e0 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:03.183319 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ca1f08bc-f2c7-48f9-ac55-fdc02d6716e0 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1710 microversion: 2.1 time: 0.159540 Jul 01 16:49:03.183890 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 464/931] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:03 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1710 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:04.201639 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4653e0d2-6d32-492f-b6bd-1af6887b6334 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:04.202364 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4653e0d2-6d32-492f-b6bd-1af6887b6334 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:04.209426 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4653e0d2-6d32-492f-b6bd-1af6887b6334 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:04.209900 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4653e0d2-6d32-492f-b6bd-1af6887b6334 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:04.210873 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4653e0d2-6d32-492f-b6bd-1af6887b6334 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:04.211308 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4653e0d2-6d32-492f-b6bd-1af6887b6334 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:04.345770 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4653e0d2-6d32-492f-b6bd-1af6887b6334 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:04.353947 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4653e0d2-6d32-492f-b6bd-1af6887b6334 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1710 microversion: 2.1 time: 0.156953 Jul 01 16:49:04.354542 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 468/932] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:04 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1710 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:05.373124 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4a75b85c-3fc4-435e-88cc-b72d9615842f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:05.373738 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4a75b85c-3fc4-435e-88cc-b72d9615842f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:05.380281 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4a75b85c-3fc4-435e-88cc-b72d9615842f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:05.380739 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4a75b85c-3fc4-435e-88cc-b72d9615842f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:05.381540 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4a75b85c-3fc4-435e-88cc-b72d9615842f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:05.381974 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4a75b85c-3fc4-435e-88cc-b72d9615842f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:05.519429 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4a75b85c-3fc4-435e-88cc-b72d9615842f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:05.527375 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4a75b85c-3fc4-435e-88cc-b72d9615842f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1714 microversion: 2.1 time: 0.158160 Jul 01 16:49:05.527937 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 465/933] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:05 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1714 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:40.257262 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-57aaf4bf-7e11-493f-abd4-944704d47e08 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-661345713", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-611014614", "security_groups": [{"name": "tempest-secgroup-smoke-1604816131"}], "block_device_mapping_v2": [{"uuid": "1fcd14dc-7023-40f1-a3b9-2e46c1b7b5cd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6911cac0-9310-49e0-9165-12c7216cb763"}]}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:49:40.266529 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=16 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:49:40.267293 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:49:40.370943 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.network.neutron [None req-57aaf4bf-7e11-493f-abd4-944704d47e08 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] validate_networks() for [('6911cac0-9310-49e0-9165-12c7216cb763', None, None, None, None, None)] {{(pid=124317) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 16:49:40.741595 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-57aaf4bf-7e11-493f-abd4-944704d47e08 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Flavor limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 16:49:40.742017 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-57aaf4bf-7e11-493f-abd4-944704d47e08 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Image limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 16:49:40.743221 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-57aaf4bf-7e11-493f-abd4-944704d47e08 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Flavor pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 16:49:40.743639 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-57aaf4bf-7e11-493f-abd4-944704d47e08 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Image pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 16:49:40.744047 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-57aaf4bf-7e11-493f-abd4-944704d47e08 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 16:49:40.753077 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-57aaf4bf-7e11-493f-abd4-944704d47e08 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:40.753524 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-57aaf4bf-7e11-493f-abd4-944704d47e08 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:40.754437 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-57aaf4bf-7e11-493f-abd4-944704d47e08 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:40.754811 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-57aaf4bf-7e11-493f-abd4-944704d47e08 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:40.772142 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-57aaf4bf-7e11-493f-abd4-944704d47e08 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Getting quotas for project 0076c4e65bce4bd58478d09d62607981. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:49:40.776321 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-57aaf4bf-7e11-493f-abd4-944704d47e08 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Getting quotas for user d6589e2636dd46838a3a0c66d18e0d00 and project 0076c4e65bce4bd58478d09d62607981. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:49:40.833093 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-57aaf4bf-7e11-493f-abd4-944704d47e08 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Going to run 1 instances... {{(pid=124317) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 16:49:40.835213 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-57aaf4bf-7e11-493f-abd4-944704d47e08 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: ebc16539-c026-4455-bb75-c1d02f6886b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1fcd14dc-7023-40f1-a3b9-2e46c1b7b5cd',volume_size=None,volume_type=None)] {{(pid=124317) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 16:49:40.965495 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-57aaf4bf-7e11-493f-abd4-944704d47e08 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.712158 Jul 01 16:49:40.966126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 469/934] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 1 16:49:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 16:49:40.976336 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0ff17c2c-53a7-41b2-a269-c972c2d81134 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:40.976933 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0ff17c2c-53a7-41b2-a269-c972c2d81134 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: ebc16539-c026-4455-bb75-c1d02f6886b9] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:40.979255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=16 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:49:40.979910 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:49:41.050648 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0ff17c2c-53a7-41b2-a269-c972c2d81134 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:41.058105 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0ff17c2c-53a7-41b2-a269-c972c2d81134 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9" status: 200 len: 1093 microversion: 2.1 time: 0.085711 Jul 01 16:49:41.058742 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 466/935] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:40 2022] GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9 => generated 1093 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:42.077094 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-98f4a267-44c1-43cb-b02d-dbc2175b13ab tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:42.077814 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-98f4a267-44c1-43cb-b02d-dbc2175b13ab tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: ebc16539-c026-4455-bb75-c1d02f6886b9] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:42.085392 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98f4a267-44c1-43cb-b02d-dbc2175b13ab tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:42.085841 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98f4a267-44c1-43cb-b02d-dbc2175b13ab tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:42.087386 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98f4a267-44c1-43cb-b02d-dbc2175b13ab tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:42.087827 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98f4a267-44c1-43cb-b02d-dbc2175b13ab tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:42.150665 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-98f4a267-44c1-43cb-b02d-dbc2175b13ab tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:42.158020 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-98f4a267-44c1-43cb-b02d-dbc2175b13ab tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9" status: 200 len: 1209 microversion: 2.1 time: 0.085046 Jul 01 16:49:42.158617 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 470/936] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:42 2022] GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9 => generated 1209 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:43.175797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-024a2455-601c-462c-b87b-a4741b3902ec tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:43.176519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-024a2455-601c-462c-b87b-a4741b3902ec tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: ebc16539-c026-4455-bb75-c1d02f6886b9] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:43.184931 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-024a2455-601c-462c-b87b-a4741b3902ec tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:43.185390 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-024a2455-601c-462c-b87b-a4741b3902ec tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:43.186174 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-024a2455-601c-462c-b87b-a4741b3902ec tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:43.186955 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-024a2455-601c-462c-b87b-a4741b3902ec tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:43.323212 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-024a2455-601c-462c-b87b-a4741b3902ec tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:43.331063 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-024a2455-601c-462c-b87b-a4741b3902ec tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9" status: 200 len: 1265 microversion: 2.1 time: 0.158894 Jul 01 16:49:43.331639 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 467/937] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:43 2022] GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:43.632749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-18823ae5-34e1-4c36-9dc9-61a6d61938df req-5a734dab-aa84-4afa-a81f-58b036a06208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebc16539-c026-4455-bb75-c1d02f6886b9", "tag": "8ec49325-cc21-4a36-a53e-e056f6781dc9"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:49:43.646830 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-18823ae5-34e1-4c36-9dc9-61a6d61938df req-5a734dab-aa84-4afa-a81f-58b036a06208 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:43.647220 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-18823ae5-34e1-4c36-9dc9-61a6d61938df req-5a734dab-aa84-4afa-a81f-58b036a06208 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:43.663509 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-18823ae5-34e1-4c36-9dc9-61a6d61938df req-5a734dab-aa84-4afa-a81f-58b036a06208 service nova] Creating event network-changed:8ec49325-cc21-4a36-a53e-e056f6781dc9 for instance ebc16539-c026-4455-bb75-c1d02f6886b9 on hv-cinder-79760 Jul 01 16:49:43.669724 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-18823ae5-34e1-4c36-9dc9-61a6d61938df req-5a734dab-aa84-4afa-a81f-58b036a06208 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040521 Jul 01 16:49:43.670332 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 471/938] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:49:44.103428 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-451b7116-c67d-4ffa-b206-9d4af6fe685c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:44.103858 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-451b7116-c67d-4ffa-b206-9d4af6fe685c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:44.110099 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-451b7116-c67d-4ffa-b206-9d4af6fe685c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:44.110604 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-451b7116-c67d-4ffa-b206-9d4af6fe685c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:44.111381 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-451b7116-c67d-4ffa-b206-9d4af6fe685c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:44.111821 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-451b7116-c67d-4ffa-b206-9d4af6fe685c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:44.192567 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-451b7116-c67d-4ffa-b206-9d4af6fe685c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lazy-loading 'services' on Instance uuid f6c54f9e-6923-4f5c-a7de-be304f3587dc {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:49:44.264392 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-451b7116-c67d-4ffa-b206-9d4af6fe685c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc/os-volume_attachments/1cd2eedb-1758-435a-a099-78a946febd01" status: 202 len: 0 microversion: 2.1 time: 0.164860 Jul 01 16:49:44.264969 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 468/939] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 1 16:49:44 2022] DELETE /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc/os-volume_attachments/1cd2eedb-1758-435a-a099-78a946febd01 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:49:44.468950 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1677661f-0ee0-4bfd-8b41-a34f264f49ad tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:44.469658 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1677661f-0ee0-4bfd-8b41-a34f264f49ad tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: ebc16539-c026-4455-bb75-c1d02f6886b9] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:44.476024 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1677661f-0ee0-4bfd-8b41-a34f264f49ad tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:44.476472 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1677661f-0ee0-4bfd-8b41-a34f264f49ad tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:44.477746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1677661f-0ee0-4bfd-8b41-a34f264f49ad tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:44.478192 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1677661f-0ee0-4bfd-8b41-a34f264f49ad tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:44.624067 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1677661f-0ee0-4bfd-8b41-a34f264f49ad tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:44.631912 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1677661f-0ee0-4bfd-8b41-a34f264f49ad tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9" status: 200 len: 1265 microversion: 2.1 time: 0.287224 Jul 01 16:49:44.632491 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 472/940] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:44 2022] GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9 => generated 1265 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:45.651320 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-38c148a5-ab2b-483b-8848-44d28d15a511 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:45.652037 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-38c148a5-ab2b-483b-8848-44d28d15a511 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: ebc16539-c026-4455-bb75-c1d02f6886b9] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:45.658985 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-38c148a5-ab2b-483b-8848-44d28d15a511 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:45.659434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-38c148a5-ab2b-483b-8848-44d28d15a511 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:45.660207 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-38c148a5-ab2b-483b-8848-44d28d15a511 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:45.660643 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-38c148a5-ab2b-483b-8848-44d28d15a511 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:45.795419 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-38c148a5-ab2b-483b-8848-44d28d15a511 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:45.802855 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-38c148a5-ab2b-483b-8848-44d28d15a511 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9" status: 200 len: 1265 microversion: 2.1 time: 0.157732 Jul 01 16:49:45.803414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 469/941] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:45 2022] GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:46.431144 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a392fbf2-b963-4c10-a33c-662a4d64b663 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:49:46.437846 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a392fbf2-b963-4c10-a33c-662a4d64b663 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:46.438296 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a392fbf2-b963-4c10-a33c-662a4d64b663 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:46.462112 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a392fbf2-b963-4c10-a33c-662a4d64b663 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Going to try to stop instance {{(pid=124317) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 01 16:49:46.505387 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a392fbf2-b963-4c10-a33c-662a4d64b663 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "POST /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc/action" status: 202 len: 0 microversion: 2.1 time: 0.077945 Jul 01 16:49:46.506213 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 473/942] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 1 16:49:46 2022] POST /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:49:46.514946 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-09a02007-e3af-4ddf-b06b-322abdbf1485 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:46.515649 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-09a02007-e3af-4ddf-b06b-322abdbf1485 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:46.521847 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-09a02007-e3af-4ddf-b06b-322abdbf1485 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:46.522424 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-09a02007-e3af-4ddf-b06b-322abdbf1485 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:46.523279 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-09a02007-e3af-4ddf-b06b-322abdbf1485 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:46.524393 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-09a02007-e3af-4ddf-b06b-322abdbf1485 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:46.672426 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-09a02007-e3af-4ddf-b06b-322abdbf1485 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:46.679954 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-09a02007-e3af-4ddf-b06b-322abdbf1485 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1678 microversion: 2.1 time: 0.168778 Jul 01 16:49:46.680544 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 470/943] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:46 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:46.819858 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5e86c043-d831-41d7-aeb9-ad47ad302bc7 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:46.821173 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5e86c043-d831-41d7-aeb9-ad47ad302bc7 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: ebc16539-c026-4455-bb75-c1d02f6886b9] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:46.827576 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5e86c043-d831-41d7-aeb9-ad47ad302bc7 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:46.828031 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5e86c043-d831-41d7-aeb9-ad47ad302bc7 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:46.828788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5e86c043-d831-41d7-aeb9-ad47ad302bc7 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:46.829224 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5e86c043-d831-41d7-aeb9-ad47ad302bc7 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:46.966572 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5e86c043-d831-41d7-aeb9-ad47ad302bc7 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:46.973981 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5e86c043-d831-41d7-aeb9-ad47ad302bc7 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9" status: 200 len: 1265 microversion: 2.1 time: 0.158351 Jul 01 16:49:46.974582 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 474/944] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:46 2022] GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:47.697224 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1c77f3b0-1550-4350-bdbe-541084afa9af tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:47.697778 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1c77f3b0-1550-4350-bdbe-541084afa9af tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:47.704248 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1c77f3b0-1550-4350-bdbe-541084afa9af tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:47.704694 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1c77f3b0-1550-4350-bdbe-541084afa9af tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:47.705461 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1c77f3b0-1550-4350-bdbe-541084afa9af tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:47.706151 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1c77f3b0-1550-4350-bdbe-541084afa9af tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:47.842244 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-1c77f3b0-1550-4350-bdbe-541084afa9af tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:47.850492 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1c77f3b0-1550-4350-bdbe-541084afa9af tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1678 microversion: 2.1 time: 0.157219 Jul 01 16:49:47.851072 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 471/945] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:47 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:47.991717 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5b29be72-bcb8-465a-8796-4584f8c27a82 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:47.992257 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5b29be72-bcb8-465a-8796-4584f8c27a82 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: ebc16539-c026-4455-bb75-c1d02f6886b9] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:47.998837 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5b29be72-bcb8-465a-8796-4584f8c27a82 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:47.999289 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5b29be72-bcb8-465a-8796-4584f8c27a82 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:48.000062 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5b29be72-bcb8-465a-8796-4584f8c27a82 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:48.000501 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5b29be72-bcb8-465a-8796-4584f8c27a82 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:48.146477 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5b29be72-bcb8-465a-8796-4584f8c27a82 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:48.155912 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5b29be72-bcb8-465a-8796-4584f8c27a82 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9" status: 200 len: 1265 microversion: 2.1 time: 0.167928 Jul 01 16:49:48.156631 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 475/946] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:47 2022] GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:48.869225 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9ec6e5d4-b8e6-4ea4-92f5-77a17ad943a0 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:48.869850 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9ec6e5d4-b8e6-4ea4-92f5-77a17ad943a0 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:48.876174 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ec6e5d4-b8e6-4ea4-92f5-77a17ad943a0 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:48.876630 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ec6e5d4-b8e6-4ea4-92f5-77a17ad943a0 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:48.877402 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ec6e5d4-b8e6-4ea4-92f5-77a17ad943a0 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:48.877844 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ec6e5d4-b8e6-4ea4-92f5-77a17ad943a0 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:49.007930 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9ec6e5d4-b8e6-4ea4-92f5-77a17ad943a0 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:49.015347 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9ec6e5d4-b8e6-4ea4-92f5-77a17ad943a0 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1678 microversion: 2.1 time: 0.150822 Jul 01 16:49:49.015915 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 472/947] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:48 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:49.173147 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d4a07b6d-e2cb-428a-9a6d-406afee8dbed tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:49.173685 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d4a07b6d-e2cb-428a-9a6d-406afee8dbed tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: ebc16539-c026-4455-bb75-c1d02f6886b9] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:49.180816 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d4a07b6d-e2cb-428a-9a6d-406afee8dbed tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:49.181275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d4a07b6d-e2cb-428a-9a6d-406afee8dbed tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:49.182036 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d4a07b6d-e2cb-428a-9a6d-406afee8dbed tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:49.182500 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d4a07b6d-e2cb-428a-9a6d-406afee8dbed tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:49.326245 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d4a07b6d-e2cb-428a-9a6d-406afee8dbed tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:49.334147 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d4a07b6d-e2cb-428a-9a6d-406afee8dbed tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9" status: 200 len: 1265 microversion: 2.1 time: 0.164942 Jul 01 16:49:49.334741 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 476/948] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:49 2022] GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:50.033125 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1359974b-2dda-4636-b1e0-90bdee7ca682 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:50.033742 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1359974b-2dda-4636-b1e0-90bdee7ca682 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:50.040161 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1359974b-2dda-4636-b1e0-90bdee7ca682 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:50.040606 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1359974b-2dda-4636-b1e0-90bdee7ca682 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:50.041366 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1359974b-2dda-4636-b1e0-90bdee7ca682 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:50.041799 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1359974b-2dda-4636-b1e0-90bdee7ca682 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:50.173540 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-1359974b-2dda-4636-b1e0-90bdee7ca682 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:50.182029 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1359974b-2dda-4636-b1e0-90bdee7ca682 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1678 microversion: 2.1 time: 0.152838 Jul 01 16:49:50.182639 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 473/949] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:50 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:50.351499 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9c8b9eb2-a2ea-4bbf-8371-0fe91df96942 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:50.352549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-9c8b9eb2-a2ea-4bbf-8371-0fe91df96942 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: ebc16539-c026-4455-bb75-c1d02f6886b9] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:50.359013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9c8b9eb2-a2ea-4bbf-8371-0fe91df96942 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:50.359452 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9c8b9eb2-a2ea-4bbf-8371-0fe91df96942 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:50.360198 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9c8b9eb2-a2ea-4bbf-8371-0fe91df96942 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:50.360625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9c8b9eb2-a2ea-4bbf-8371-0fe91df96942 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:50.493896 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9c8b9eb2-a2ea-4bbf-8371-0fe91df96942 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:50.502239 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9c8b9eb2-a2ea-4bbf-8371-0fe91df96942 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9" status: 200 len: 1265 microversion: 2.1 time: 0.154653 Jul 01 16:49:50.502831 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 477/950] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:50 2022] GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:51.200233 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-05e603a3-67a7-443f-b55a-7cc8551138a8 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:51.200916 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-05e603a3-67a7-443f-b55a-7cc8551138a8 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:51.203436 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:49:51.209252 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-05e603a3-67a7-443f-b55a-7cc8551138a8 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:51.209706 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-05e603a3-67a7-443f-b55a-7cc8551138a8 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:51.210630 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-05e603a3-67a7-443f-b55a-7cc8551138a8 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:51.211162 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-05e603a3-67a7-443f-b55a-7cc8551138a8 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:51.351997 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-05e603a3-67a7-443f-b55a-7cc8551138a8 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:51.359780 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-05e603a3-67a7-443f-b55a-7cc8551138a8 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1678 microversion: 2.1 time: 0.164251 Jul 01 16:49:51.360350 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 474/951] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:51 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:51.520225 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7232213a-a62c-470d-a680-07812da92b1d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:51.520937 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7232213a-a62c-470d-a680-07812da92b1d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: ebc16539-c026-4455-bb75-c1d02f6886b9] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:51.522969 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:49:51.523685 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=6 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:49:51.530114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7232213a-a62c-470d-a680-07812da92b1d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:51.530591 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7232213a-a62c-470d-a680-07812da92b1d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:51.531371 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7232213a-a62c-470d-a680-07812da92b1d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:51.531810 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7232213a-a62c-470d-a680-07812da92b1d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:51.676522 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7232213a-a62c-470d-a680-07812da92b1d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:51.686307 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7232213a-a62c-470d-a680-07812da92b1d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9" status: 200 len: 1265 microversion: 2.1 time: 0.169711 Jul 01 16:49:51.687225 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 478/952] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:51 2022] GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:52.378035 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-29245367-d79f-469d-84a7-497577cedc98 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:52.378704 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-29245367-d79f-469d-84a7-497577cedc98 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:52.385685 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-29245367-d79f-469d-84a7-497577cedc98 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:52.386138 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-29245367-d79f-469d-84a7-497577cedc98 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:52.386933 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-29245367-d79f-469d-84a7-497577cedc98 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:52.387373 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-29245367-d79f-469d-84a7-497577cedc98 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:52.521579 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-29245367-d79f-469d-84a7-497577cedc98 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:52.530068 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-29245367-d79f-469d-84a7-497577cedc98 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1678 microversion: 2.1 time: 0.155954 Jul 01 16:49:52.530739 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 475/953] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:52 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:52.703943 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-27575442-bb85-4263-9902-92223c3d5075 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:52.704486 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-27575442-bb85-4263-9902-92223c3d5075 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: ebc16539-c026-4455-bb75-c1d02f6886b9] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:52.712037 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-27575442-bb85-4263-9902-92223c3d5075 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:52.712495 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-27575442-bb85-4263-9902-92223c3d5075 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:52.713255 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-27575442-bb85-4263-9902-92223c3d5075 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:52.713696 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-27575442-bb85-4263-9902-92223c3d5075 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:52.843565 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-27575442-bb85-4263-9902-92223c3d5075 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:52.851237 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-27575442-bb85-4263-9902-92223c3d5075 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9" status: 200 len: 1265 microversion: 2.1 time: 0.151128 Jul 01 16:49:52.851837 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 479/954] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:52 2022] GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:53.011835 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-a6523cbe-f307-441d-9316-ff81928315b4 req-24bd3154-bb95-4d1a-a822-b83155af7f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebc16539-c026-4455-bb75-c1d02f6886b9", "name": "network-vif-plugged", "status": "completed", "tag": "8ec49325-cc21-4a36-a53e-e056f6781dc9"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:49:53.020806 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-a6523cbe-f307-441d-9316-ff81928315b4 req-24bd3154-bb95-4d1a-a822-b83155af7f4f service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:53.021311 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-a6523cbe-f307-441d-9316-ff81928315b4 req-24bd3154-bb95-4d1a-a822-b83155af7f4f service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:53.033921 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-a6523cbe-f307-441d-9316-ff81928315b4 req-24bd3154-bb95-4d1a-a822-b83155af7f4f service nova] Creating event network-vif-plugged:8ec49325-cc21-4a36-a53e-e056f6781dc9 for instance ebc16539-c026-4455-bb75-c1d02f6886b9 on hv-cinder-79760 Jul 01 16:49:53.038943 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-a6523cbe-f307-441d-9316-ff81928315b4 req-24bd3154-bb95-4d1a-a822-b83155af7f4f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031389 Jul 01 16:49:53.039866 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 476/955] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:49:53.547508 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-11ba7215-6c6f-4bc9-bb55-c3bec26f3e9b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:53.548119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-11ba7215-6c6f-4bc9-bb55-c3bec26f3e9b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:53.554119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-11ba7215-6c6f-4bc9-bb55-c3bec26f3e9b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:53.554595 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-11ba7215-6c6f-4bc9-bb55-c3bec26f3e9b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:53.557462 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-11ba7215-6c6f-4bc9-bb55-c3bec26f3e9b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:53.557908 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-11ba7215-6c6f-4bc9-bb55-c3bec26f3e9b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:53.692016 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-11ba7215-6c6f-4bc9-bb55-c3bec26f3e9b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:53.700121 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-11ba7215-6c6f-4bc9-bb55-c3bec26f3e9b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1678 microversion: 2.1 time: 0.156508 Jul 01 16:49:53.700691 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 480/956] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:53 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:53.869425 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-617c09f6-d132-4d1f-a717-8e554b1cccf5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:53.870123 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-617c09f6-d132-4d1f-a717-8e554b1cccf5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: ebc16539-c026-4455-bb75-c1d02f6886b9] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:53.876932 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-617c09f6-d132-4d1f-a717-8e554b1cccf5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:53.877384 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-617c09f6-d132-4d1f-a717-8e554b1cccf5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:53.878153 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-617c09f6-d132-4d1f-a717-8e554b1cccf5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:53.878623 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-617c09f6-d132-4d1f-a717-8e554b1cccf5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:54.011085 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-617c09f6-d132-4d1f-a717-8e554b1cccf5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:54.018410 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-617c09f6-d132-4d1f-a717-8e554b1cccf5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9" status: 200 len: 1265 microversion: 2.1 time: 0.154000 Jul 01 16:49:54.018973 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 477/957] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:53 2022] GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:54.718007 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-753c2c95-f137-477f-8adb-e5fbfc9e6dea tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:54.718604 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-753c2c95-f137-477f-8adb-e5fbfc9e6dea tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:54.725135 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-753c2c95-f137-477f-8adb-e5fbfc9e6dea tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:54.725586 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-753c2c95-f137-477f-8adb-e5fbfc9e6dea tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:54.726370 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-753c2c95-f137-477f-8adb-e5fbfc9e6dea tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:54.726941 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-753c2c95-f137-477f-8adb-e5fbfc9e6dea tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:54.858147 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-753c2c95-f137-477f-8adb-e5fbfc9e6dea tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:54.865592 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-753c2c95-f137-477f-8adb-e5fbfc9e6dea tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1678 microversion: 2.1 time: 0.151526 Jul 01 16:49:54.866157 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 481/958] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:54 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:55.034595 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6db0dd05-51bd-44b4-a3d8-810de8a11cef tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:55.035217 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6db0dd05-51bd-44b4-a3d8-810de8a11cef tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: ebc16539-c026-4455-bb75-c1d02f6886b9] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:55.042661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6db0dd05-51bd-44b4-a3d8-810de8a11cef tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:55.043176 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6db0dd05-51bd-44b4-a3d8-810de8a11cef tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:55.043930 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6db0dd05-51bd-44b4-a3d8-810de8a11cef tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:55.044378 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6db0dd05-51bd-44b4-a3d8-810de8a11cef tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:55.182730 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6db0dd05-51bd-44b4-a3d8-810de8a11cef tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:55.190142 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6db0dd05-51bd-44b4-a3d8-810de8a11cef tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9" status: 200 len: 1452 microversion: 2.1 time: 0.159481 Jul 01 16:49:55.190738 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 478/959] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:55 2022] GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:55.207775 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8b01b3de-684b-4cfe-8e4c-a7d389a03e7c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:55.208388 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8b01b3de-684b-4cfe-8e4c-a7d389a03e7c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: ebc16539-c026-4455-bb75-c1d02f6886b9] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:55.215017 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8b01b3de-684b-4cfe-8e4c-a7d389a03e7c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:55.215468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8b01b3de-684b-4cfe-8e4c-a7d389a03e7c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:55.216231 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8b01b3de-684b-4cfe-8e4c-a7d389a03e7c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:55.216671 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8b01b3de-684b-4cfe-8e4c-a7d389a03e7c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:55.350585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8b01b3de-684b-4cfe-8e4c-a7d389a03e7c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:55.358316 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8b01b3de-684b-4cfe-8e4c-a7d389a03e7c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9" status: 200 len: 1452 microversion: 2.1 time: 0.154676 Jul 01 16:49:55.358931 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 482/960] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:55 2022] GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:55.882903 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e0065bd4-8d34-470c-bc35-65c38e6b16df tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:55.884354 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e0065bd4-8d34-470c-bc35-65c38e6b16df tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:55.890610 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e0065bd4-8d34-470c-bc35-65c38e6b16df tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:55.891061 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e0065bd4-8d34-470c-bc35-65c38e6b16df tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:55.891824 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e0065bd4-8d34-470c-bc35-65c38e6b16df tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:55.892258 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e0065bd4-8d34-470c-bc35-65c38e6b16df tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:56.126542 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e0065bd4-8d34-470c-bc35-65c38e6b16df tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:56.134864 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e0065bd4-8d34-470c-bc35-65c38e6b16df tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1678 microversion: 2.1 time: 0.255760 Jul 01 16:49:56.135450 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 479/961] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:55 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1678 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:57.084209 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-c2215445-a6e0-446f-9aca-e7c9605b7b00 req-d1499e2b-f5bd-480e-b72a-35e028e853f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebc16539-c026-4455-bb75-c1d02f6886b9", "tag": "8ec49325-cc21-4a36-a53e-e056f6781dc9"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:49:57.095139 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-c2215445-a6e0-446f-9aca-e7c9605b7b00 req-d1499e2b-f5bd-480e-b72a-35e028e853f2 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:57.095587 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-c2215445-a6e0-446f-9aca-e7c9605b7b00 req-d1499e2b-f5bd-480e-b72a-35e028e853f2 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:57.107233 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-c2215445-a6e0-446f-9aca-e7c9605b7b00 req-d1499e2b-f5bd-480e-b72a-35e028e853f2 service nova] Creating event network-changed:8ec49325-cc21-4a36-a53e-e056f6781dc9 for instance ebc16539-c026-4455-bb75-c1d02f6886b9 on hv-cinder-79760 Jul 01 16:49:57.112631 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-c2215445-a6e0-446f-9aca-e7c9605b7b00 req-d1499e2b-f5bd-480e-b72a-35e028e853f2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035102 Jul 01 16:49:57.113447 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 483/962] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:49:57.152674 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-13828e0e-9be9-40fd-bf6d-c9c9ae0fd384 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:57.153291 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-13828e0e-9be9-40fd-bf6d-c9c9ae0fd384 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:57.159937 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13828e0e-9be9-40fd-bf6d-c9c9ae0fd384 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:57.160393 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13828e0e-9be9-40fd-bf6d-c9c9ae0fd384 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:57.161167 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13828e0e-9be9-40fd-bf6d-c9c9ae0fd384 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:57.161608 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13828e0e-9be9-40fd-bf6d-c9c9ae0fd384 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:57.317091 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-13828e0e-9be9-40fd-bf6d-c9c9ae0fd384 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:57.326783 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-13828e0e-9be9-40fd-bf6d-c9c9ae0fd384 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1655 microversion: 2.1 time: 0.178642 Jul 01 16:49:57.327374 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 480/963] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:57 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1655 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:57.344390 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1b444a06-99b7-4633-ada8-fb332ec9bfe3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:49:57.352108 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1b444a06-99b7-4633-ada8-fb332ec9bfe3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:57.352783 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1b444a06-99b7-4633-ada8-fb332ec9bfe3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:57.379067 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1b444a06-99b7-4633-ada8-fb332ec9bfe3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Going to try to start instance {{(pid=124317) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 01 16:49:57.428467 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1b444a06-99b7-4633-ada8-fb332ec9bfe3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "POST /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc/action" status: 202 len: 0 microversion: 2.1 time: 0.088382 Jul 01 16:49:57.429231 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 484/964] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Jul 1 16:49:57 2022] POST /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 16:49:57.453583 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9a619455-f7fa-4dc7-9f87-a0f6d82ddb6f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:57.454518 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9a619455-f7fa-4dc7-9f87-a0f6d82ddb6f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:57.461082 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9a619455-f7fa-4dc7-9f87-a0f6d82ddb6f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:57.461568 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9a619455-f7fa-4dc7-9f87-a0f6d82ddb6f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:57.462560 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9a619455-f7fa-4dc7-9f87-a0f6d82ddb6f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:57.463152 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9a619455-f7fa-4dc7-9f87-a0f6d82ddb6f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:57.677431 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9a619455-f7fa-4dc7-9f87-a0f6d82ddb6f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:57.703118 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9a619455-f7fa-4dc7-9f87-a0f6d82ddb6f tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1664 microversion: 2.1 time: 0.256611 Jul 01 16:49:57.704520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 481/965] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:57 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1664 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:58.723165 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3fd4316b-c2b3-4abc-9288-37b85e060810 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:58.723859 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3fd4316b-c2b3-4abc-9288-37b85e060810 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:58.731224 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3fd4316b-c2b3-4abc-9288-37b85e060810 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:58.731672 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3fd4316b-c2b3-4abc-9288-37b85e060810 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:58.732423 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3fd4316b-c2b3-4abc-9288-37b85e060810 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:58.732854 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3fd4316b-c2b3-4abc-9288-37b85e060810 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:58.751807 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:49:58.874518 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3fd4316b-c2b3-4abc-9288-37b85e060810 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:49:58.882015 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3fd4316b-c2b3-4abc-9288-37b85e060810 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1664 microversion: 2.1 time: 0.163612 Jul 01 16:49:58.882622 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 485/966] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:58 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:49:59.900396 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-21130259-4658-4f21-bee0-55c96afc9f57 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:49:59.901003 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-21130259-4658-4f21-bee0-55c96afc9f57 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:49:59.907559 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-21130259-4658-4f21-bee0-55c96afc9f57 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:59.908011 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-21130259-4658-4f21-bee0-55c96afc9f57 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:49:59.908774 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-21130259-4658-4f21-bee0-55c96afc9f57 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:49:59.909213 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-21130259-4658-4f21-bee0-55c96afc9f57 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:00.038324 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-21130259-4658-4f21-bee0-55c96afc9f57 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:50:00.046596 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-21130259-4658-4f21-bee0-55c96afc9f57 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1668 microversion: 2.1 time: 0.150722 Jul 01 16:50:00.047170 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 482/967] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:49:59 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:50:22.933571 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 16:50:22.934271 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Fri Jul 1 16:50:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 16:50:35.758158 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4f133ada-84a2-4167-b91f-ba87dc090df9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:50:35.759372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4f133ada-84a2-4167-b91f-ba87dc090df9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:50:35.761453 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:50:35.762253 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:50:35.767689 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4f133ada-84a2-4167-b91f-ba87dc090df9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:35.768127 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4f133ada-84a2-4167-b91f-ba87dc090df9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:35.768876 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4f133ada-84a2-4167-b91f-ba87dc090df9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:35.769319 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4f133ada-84a2-4167-b91f-ba87dc090df9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:35.800380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4f133ada-84a2-4167-b91f-ba87dc090df9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046244 Jul 01 16:50:35.800946 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 486/968] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 1 16:50:35 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 16:50:35.858778 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5d531a3d-d720-4ff9-87a7-301c44f9201b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:50:35.859277 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5d531a3d-d720-4ff9-87a7-301c44f9201b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:50:35.861372 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=36 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:50:35.862021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:50:35.868203 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5d531a3d-d720-4ff9-87a7-301c44f9201b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:35.868659 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5d531a3d-d720-4ff9-87a7-301c44f9201b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:35.869432 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5d531a3d-d720-4ff9-87a7-301c44f9201b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:35.869872 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5d531a3d-d720-4ff9-87a7-301c44f9201b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:35.898014 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5d531a3d-d720-4ff9-87a7-301c44f9201b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 16:50:35.973605 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5d531a3d-d720-4ff9-87a7-301c44f9201b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 204 len: 0 microversion: 2.1 time: 0.118474 Jul 01 16:50:35.974099 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 483/969] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:50:35 2022] DELETE /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 16:50:35.982331 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-62d0b916-5c83-4931-9aa6-b32453609693 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:50:35.982963 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-62d0b916-5c83-4931-9aa6-b32453609693 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:50:35.989153 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-62d0b916-5c83-4931-9aa6-b32453609693 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:35.989594 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-62d0b916-5c83-4931-9aa6-b32453609693 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:35.990340 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-62d0b916-5c83-4931-9aa6-b32453609693 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:35.990797 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-62d0b916-5c83-4931-9aa6-b32453609693 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:36.226854 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-62d0b916-5c83-4931-9aa6-b32453609693 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:50:36.234275 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-62d0b916-5c83-4931-9aa6-b32453609693 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1674 microversion: 2.1 time: 0.255893 Jul 01 16:50:36.234871 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 487/970] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:50:35 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1674 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:50:37.251875 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0a1f13fa-83b3-4ab9-bd42-b5ca26d48396 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:50:37.252562 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0a1f13fa-83b3-4ab9-bd42-b5ca26d48396 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:50:37.258939 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0a1f13fa-83b3-4ab9-bd42-b5ca26d48396 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:37.259377 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0a1f13fa-83b3-4ab9-bd42-b5ca26d48396 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:37.260127 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0a1f13fa-83b3-4ab9-bd42-b5ca26d48396 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:37.260557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0a1f13fa-83b3-4ab9-bd42-b5ca26d48396 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:37.442980 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0a1f13fa-83b3-4ab9-bd42-b5ca26d48396 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:50:37.451226 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0a1f13fa-83b3-4ab9-bd42-b5ca26d48396 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1674 microversion: 2.1 time: 0.203557 Jul 01 16:50:37.451782 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 484/971] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:50:37 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1674 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:50:38.469428 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5be2c449-958d-475f-837f-a6d6ed930f20 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:50:38.470028 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5be2c449-958d-475f-837f-a6d6ed930f20 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:50:38.476439 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5be2c449-958d-475f-837f-a6d6ed930f20 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:38.476875 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5be2c449-958d-475f-837f-a6d6ed930f20 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:38.478154 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5be2c449-958d-475f-837f-a6d6ed930f20 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:38.478613 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5be2c449-958d-475f-837f-a6d6ed930f20 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:39.010095 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5be2c449-958d-475f-837f-a6d6ed930f20 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:50:39.014846 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5be2c449-958d-475f-837f-a6d6ed930f20 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1674 microversion: 2.1 time: 0.550032 Jul 01 16:50:39.015440 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 488/972] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:50:38 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1674 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:50:39.515625 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-b327e628-8ffb-41a6-862d-9c7fa4ca3506 req-695dbaba-f21a-4139-8fff-ad93fd9be403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c54f9e-6923-4f5c-a7de-be304f3587dc", "name": "network-vif-deleted", "tag": "15751548-66ba-4e21-a18e-20e6858b091e"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:50:39.526488 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-b327e628-8ffb-41a6-862d-9c7fa4ca3506 req-695dbaba-f21a-4139-8fff-ad93fd9be403 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:39.526943 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-b327e628-8ffb-41a6-862d-9c7fa4ca3506 req-695dbaba-f21a-4139-8fff-ad93fd9be403 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:39.539053 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-b327e628-8ffb-41a6-862d-9c7fa4ca3506 req-695dbaba-f21a-4139-8fff-ad93fd9be403 service nova] Creating event network-vif-deleted:15751548-66ba-4e21-a18e-20e6858b091e for instance f6c54f9e-6923-4f5c-a7de-be304f3587dc on hv-cinder-79760 Jul 01 16:50:39.544271 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-b327e628-8ffb-41a6-862d-9c7fa4ca3506 req-695dbaba-f21a-4139-8fff-ad93fd9be403 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032213 Jul 01 16:50:39.544873 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 485/973] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:50:40.033882 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-fade2ee5-d441-4487-a34b-68b42c081a09 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:50:40.035162 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-fade2ee5-d441-4487-a34b-68b42c081a09 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:50:40.043131 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fade2ee5-d441-4487-a34b-68b42c081a09 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:40.043605 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fade2ee5-d441-4487-a34b-68b42c081a09 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:40.044551 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fade2ee5-d441-4487-a34b-68b42c081a09 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:40.044992 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fade2ee5-d441-4487-a34b-68b42c081a09 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:40.079442 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fade2ee5-d441-4487-a34b-68b42c081a09 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:40.079878 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fade2ee5-d441-4487-a34b-68b42c081a09 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:40.080576 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-fade2ee5-d441-4487-a34b-68b42c081a09 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lazy-loading 'fault' on Instance uuid f6c54f9e-6923-4f5c-a7de-be304f3587dc {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:50:40.126211 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-fade2ee5-d441-4487-a34b-68b42c081a09 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:50:40.135003 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-fade2ee5-d441-4487-a34b-68b42c081a09 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 200 len: 1327 microversion: 2.1 time: 0.106241 Jul 01 16:50:40.143404 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 489/974] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:50:40 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:50:41.153456 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f6082b0c-86a3-4475-8299-9ea0b5b2de96 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:50:41.154371 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f6082b0c-86a3-4475-8299-9ea0b5b2de96 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:50:41.161911 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f6082b0c-86a3-4475-8299-9ea0b5b2de96 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:41.162381 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f6082b0c-86a3-4475-8299-9ea0b5b2de96 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:41.163158 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f6082b0c-86a3-4475-8299-9ea0b5b2de96 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:41.163676 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f6082b0c-86a3-4475-8299-9ea0b5b2de96 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:41.177198 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-f6082b0c-86a3-4475-8299-9ea0b5b2de96 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] HTTP exception thrown: Instance f6c54f9e-6923-4f5c-a7de-be304f3587dc could not be found. Jul 01 16:50:41.178876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f6082b0c-86a3-4475-8299-9ea0b5b2de96 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Request method failure captured: Jul 01 16:50:41.178876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc HTTP/1.1 Jul 01 16:50:41.178876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:50:41.178876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:50:41.178876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:50:41.178876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:50:41.178876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:50:41.178876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:50:41.178876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:50:41.178876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:50:41.178876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyU16ejK507feFCzhWk8yY7CCzlL_Fv1ZIz6WjVcLYPsiPnhCyAnXJk4Pbz9iq6UEmup4njL0gr48QoyGdTJcBPjggU9MPvdIJLECXy3tKai7cwyoc_-hTOazqQgKK7iz5WYkj_T6SGCs2mRghajePcUx-Ey59912UzjbFQbBDTgHjo Jul 01 16:50:41.178876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:50:41.178876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:50:41.178876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:50:41.178876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:50:41.178876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:50:41.178876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:50:41.178876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: b1b152a7ad4d44f8a292995a1598d238 Jul 01 16:50:41.178876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeTestJSON-1720658346 Jul 01 16:50:41.178876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:50:41.178876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:50:41.180722 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:50:41.180722 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeTestJSON-1720658346 Jul 01 16:50:41.180722 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: b1b152a7ad4d44f8a292995a1598d238 Jul 01 16:50:41.180722 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1720658346 Jul 01 16:50:41.180722 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeTestJSON-1720658346-project Jul 01 16:50:41.180722 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:50:41.180722 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:50:41.180722 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: f25bcb63e6194aa9884e589db9f7ede6 Jul 01 16:50:41.180722 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeTestJSON-1720658346-project Jul 01 16:50:41.180722 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: > Jul 01 16:50:41.180722 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Instance f6c54f9e-6923-4f5c-a7de-be304f3587dc could not be found. Jul 01 16:50:41.180722 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'id': 'f6c54f9e-6923-4f5c-a7de-be304f3587dc'} Jul 01 16:50:41.181957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:50:41.181957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:50:41.181957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:50:41.181957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:50:41.181957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:50:41.181957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:50:41.181957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:50:41.181957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:50:41.181957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:50:41.181957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:50:41.181957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6c54f9e-6923-4f5c-a7de-be304f3587dc could not be found. Jul 01 16:50:41.181957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:50:41.181957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:50:41.181957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:50:41.181957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:50:41.181957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:50:41.181957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:50:41.181957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:50:41.181957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:50:41.181957 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:50:41.183580 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:50:41.183580 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:50:41.183580 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:50:41.183580 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:50:41.183580 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:50:41.183580 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:50:41.183580 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:50:41.183580 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6c54f9e-6923-4f5c-a7de-be304f3587dc could not be found. Jul 01 16:50:41.183580 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:50:41.183580 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:50:41.183580 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:50:41.183580 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:50:41.183580 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:50:41.183580 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:50:41.183580 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:50:41.183580 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:50:41.183580 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6c54f9e-6923-4f5c-a7de-be304f3587dc could not be found. Jul 01 16:50:41.183580 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:50:41.185180 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f6082b0c-86a3-4475-8299-9ea0b5b2de96 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Returning 404 to user: Instance f6c54f9e-6923-4f5c-a7de-be304f3587dc could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:50:41.185180 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f6082b0c-86a3-4475-8299-9ea0b5b2de96 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 404 len: 111 microversion: 2.1 time: 0.031681 Jul 01 16:50:41.185180 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 486/975] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:50:41 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:50:41.194409 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d745dd07-1d8b-4f35-8342-f9cf764efcf9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '.version_select at 0x7fa86c3c7ca0>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:50:41.214402 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d745dd07-1d8b-4f35-8342-f9cf764efcf9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1763066210" status: 202 len: 0 microversion: 2.1 time: 0.026644 Jul 01 16:50:41.214983 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 490/976] 10.222.0.57 () {58 vars in 1220 bytes} [Fri Jul 1 16:50:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1763066210 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:50:41.837619 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b74c0a71-8b42-4156-b6eb-d2fd36e34943 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Action: 'create', calling method: .version_select at 0x7fa85f6898b0>, body: {"keypair": {"name": "tempest-keypair-259786133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZWnCoHAtjArTBPh1btkFaPTnUYz6OgrO1MLEh/VLRDVQEgBNmTlZ+ORpXfzbfjb+MH936RA+Rs9SvhKtEn2Uj7rGrrKo7nvEMgZVf6+Exscg+9hmr1jz3MxtEMDH7VLw=="}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:50:41.851572 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-b74c0a71-8b42-4156-b6eb-d2fd36e34943 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Getting quotas for project b1b152a7ad4d44f8a292995a1598d238. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:50:41.856113 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-b74c0a71-8b42-4156-b6eb-d2fd36e34943 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Getting quotas for user f25bcb63e6194aa9884e589db9f7ede6 and project b1b152a7ad4d44f8a292995a1598d238. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:50:41.881035 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b74c0a71-8b42-4156-b6eb-d2fd36e34943 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047915 Jul 01 16:50:41.881622 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 487/977] 10.222.0.57 () {60 vars in 1158 bytes} [Fri Jul 1 16:50:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:50:43.185002 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a0b920a9-6bff-4b97-858a-e5490417f97b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-418509713", "imageRef": "42a4b1a9-dea6-4c87-a2c1-328b9c0c8558", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b36dbd7-72b5-4d72-9df6-342ee9de795a"}], "security_groups": [{"name": "tempest-securitygroup--555139934"}], "key_name": "tempest-keypair-259786133", "user_data": "}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:50:43.291859 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.network.neutron [None req-a0b920a9-6bff-4b97-858a-e5490417f97b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] validate_networks() for [('3b36dbd7-72b5-4d72-9df6-342ee9de795a', None, None, None, None, None)] {{(pid=124317) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 16:50:43.683963 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-a0b920a9-6bff-4b97-858a-e5490417f97b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Flavor limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 16:50:43.684385 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-a0b920a9-6bff-4b97-858a-e5490417f97b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Image limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 16:50:43.684889 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-a0b920a9-6bff-4b97-858a-e5490417f97b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Flavor pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 16:50:43.685328 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-a0b920a9-6bff-4b97-858a-e5490417f97b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Image pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 16:50:43.685805 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-a0b920a9-6bff-4b97-858a-e5490417f97b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 16:50:43.694733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a0b920a9-6bff-4b97-858a-e5490417f97b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:43.695178 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a0b920a9-6bff-4b97-858a-e5490417f97b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:43.696444 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a0b920a9-6bff-4b97-858a-e5490417f97b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:43.696885 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a0b920a9-6bff-4b97-858a-e5490417f97b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:43.713788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-a0b920a9-6bff-4b97-858a-e5490417f97b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Getting quotas for project b1b152a7ad4d44f8a292995a1598d238. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:50:43.717762 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-a0b920a9-6bff-4b97-858a-e5490417f97b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Getting quotas for user f25bcb63e6194aa9884e589db9f7ede6 and project b1b152a7ad4d44f8a292995a1598d238. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:50:43.729636 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a0b920a9-6bff-4b97-858a-e5490417f97b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Going to run 1 instances... {{(pid=124317) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 16:50:43.731907 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a0b920a9-6bff-4b97-858a-e5490417f97b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42a4b1a9-dea6-4c87-a2c1-328b9c0c8558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124317) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 16:50:43.781986 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a0b920a9-6bff-4b97-858a-e5490417f97b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.602732 Jul 01 16:50:43.782674 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 491/978] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 1 16:50:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 16:50:43.794021 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ba50acc1-4298-42dd-ac0d-3e186546f3e8 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:50:43.794725 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ba50acc1-4298-42dd-ac0d-3e186546f3e8 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:50:43.860623 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ba50acc1-4298-42dd-ac0d-3e186546f3e8 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:50:43.867936 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ba50acc1-4298-42dd-ac0d-3e186546f3e8 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a" status: 200 len: 1236 microversion: 2.1 time: 0.078759 Jul 01 16:50:43.868600 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 488/979] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:50:43 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a => generated 1236 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:50:44.887039 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-aa9acad1-da83-45b1-8a78-f9d3f7ecc5d5 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:50:44.888447 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-aa9acad1-da83-45b1-8a78-f9d3f7ecc5d5 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:50:44.898839 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aa9acad1-da83-45b1-8a78-f9d3f7ecc5d5 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:44.899586 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aa9acad1-da83-45b1-8a78-f9d3f7ecc5d5 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:44.900464 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aa9acad1-da83-45b1-8a78-f9d3f7ecc5d5 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:44.901014 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aa9acad1-da83-45b1-8a78-f9d3f7ecc5d5 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:44.984363 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-aa9acad1-da83-45b1-8a78-f9d3f7ecc5d5 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:50:44.993398 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-aa9acad1-da83-45b1-8a78-f9d3f7ecc5d5 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a" status: 200 len: 1296 microversion: 2.1 time: 0.111121 Jul 01 16:50:44.994107 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 492/980] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:50:44 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a => generated 1296 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:50:46.011497 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a3591a6c-2390-449f-a98e-38560371e017 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:50:46.012107 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a3591a6c-2390-449f-a98e-38560371e017 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:50:46.018663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a3591a6c-2390-449f-a98e-38560371e017 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:46.019114 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a3591a6c-2390-449f-a98e-38560371e017 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:46.019891 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a3591a6c-2390-449f-a98e-38560371e017 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:46.020332 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a3591a6c-2390-449f-a98e-38560371e017 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:46.224086 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a3591a6c-2390-449f-a98e-38560371e017 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:50:46.232193 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a3591a6c-2390-449f-a98e-38560371e017 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a" status: 200 len: 1361 microversion: 2.1 time: 0.225551 Jul 01 16:50:46.233134 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 489/981] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:50:46 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:50:46.451066 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-f60dc68d-4340-44ba-8b89-cc11300a4a5e req-e62f8c8c-2269-462b-b464-67e1e9d6c3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d621fc2-bc77-4d1d-b083-269b49a2133a", "tag": "9c4e80c0-564e-49e0-b7cf-d9a47b529be5"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:50:46.464886 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-f60dc68d-4340-44ba-8b89-cc11300a4a5e req-e62f8c8c-2269-462b-b464-67e1e9d6c3a7 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:46.465609 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-f60dc68d-4340-44ba-8b89-cc11300a4a5e req-e62f8c8c-2269-462b-b464-67e1e9d6c3a7 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:46.484445 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-f60dc68d-4340-44ba-8b89-cc11300a4a5e req-e62f8c8c-2269-462b-b464-67e1e9d6c3a7 service nova] Creating event network-changed:9c4e80c0-564e-49e0-b7cf-d9a47b529be5 for instance 6d621fc2-bc77-4d1d-b083-269b49a2133a on hv-cinder-79760 Jul 01 16:50:46.489408 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-f60dc68d-4340-44ba-8b89-cc11300a4a5e req-e62f8c8c-2269-462b-b464-67e1e9d6c3a7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043293 Jul 01 16:50:46.490075 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 493/982] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:50:47.249243 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ba0e5051-26b7-47c5-b302-7bf1d4b6e5bb tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:50:47.249773 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ba0e5051-26b7-47c5-b302-7bf1d4b6e5bb tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:50:47.256380 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ba0e5051-26b7-47c5-b302-7bf1d4b6e5bb tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:47.256843 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ba0e5051-26b7-47c5-b302-7bf1d4b6e5bb tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:47.257608 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ba0e5051-26b7-47c5-b302-7bf1d4b6e5bb tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:47.258699 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ba0e5051-26b7-47c5-b302-7bf1d4b6e5bb tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:47.393039 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ba0e5051-26b7-47c5-b302-7bf1d4b6e5bb tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:50:47.401361 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ba0e5051-26b7-47c5-b302-7bf1d4b6e5bb tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a" status: 200 len: 1361 microversion: 2.1 time: 0.156046 Jul 01 16:50:47.401931 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 490/983] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:50:47 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:50:48.214566 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 16:50:48.214911 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Fri Jul 1 16:50:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 16:50:48.419957 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-add957aa-2773-48bd-9849-a4554049b113 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:50:48.421348 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-add957aa-2773-48bd-9849-a4554049b113 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:50:48.428629 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-add957aa-2773-48bd-9849-a4554049b113 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:48.429555 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-add957aa-2773-48bd-9849-a4554049b113 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:48.430840 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-add957aa-2773-48bd-9849-a4554049b113 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:48.431274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-add957aa-2773-48bd-9849-a4554049b113 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:48.585516 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-add957aa-2773-48bd-9849-a4554049b113 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:50:48.595299 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-add957aa-2773-48bd-9849-a4554049b113 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a" status: 200 len: 1361 microversion: 2.1 time: 0.180623 Jul 01 16:50:48.595885 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 494/984] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:50:48 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:50:49.612696 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2b036bae-e588-496a-914d-5c18fb59d575 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:50:49.613301 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2b036bae-e588-496a-914d-5c18fb59d575 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:50:49.619785 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2b036bae-e588-496a-914d-5c18fb59d575 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:49.620231 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2b036bae-e588-496a-914d-5c18fb59d575 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:49.620990 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2b036bae-e588-496a-914d-5c18fb59d575 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:49.621423 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2b036bae-e588-496a-914d-5c18fb59d575 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:49.755937 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2b036bae-e588-496a-914d-5c18fb59d575 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:50:49.765709 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2b036bae-e588-496a-914d-5c18fb59d575 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a" status: 200 len: 1361 microversion: 2.1 time: 0.156800 Jul 01 16:50:49.766296 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 491/985] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:50:49 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:50:50.781549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a5c7e4b2-47d0-4501-9ddb-c287580272d8 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:50:50.782159 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a5c7e4b2-47d0-4501-9ddb-c287580272d8 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:50:50.788710 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a5c7e4b2-47d0-4501-9ddb-c287580272d8 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:50.790004 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a5c7e4b2-47d0-4501-9ddb-c287580272d8 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:50.790968 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a5c7e4b2-47d0-4501-9ddb-c287580272d8 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:50.791402 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a5c7e4b2-47d0-4501-9ddb-c287580272d8 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:50.926359 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a5c7e4b2-47d0-4501-9ddb-c287580272d8 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:50:50.933806 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a5c7e4b2-47d0-4501-9ddb-c287580272d8 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a" status: 200 len: 1361 microversion: 2.1 time: 0.156184 Jul 01 16:50:50.934407 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 495/986] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:50:50 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:50:51.347474 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-d40b7dac-f204-4446-a829-2f4925542f9e req-b29a44b4-da9c-44d8-a38b-b0b30ab513e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d621fc2-bc77-4d1d-b083-269b49a2133a", "name": "network-vif-plugged", "status": "completed", "tag": "9c4e80c0-564e-49e0-b7cf-d9a47b529be5"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:50:51.356792 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-d40b7dac-f204-4446-a829-2f4925542f9e req-b29a44b4-da9c-44d8-a38b-b0b30ab513e1 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:51.357235 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-d40b7dac-f204-4446-a829-2f4925542f9e req-b29a44b4-da9c-44d8-a38b-b0b30ab513e1 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:51.369410 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-d40b7dac-f204-4446-a829-2f4925542f9e req-b29a44b4-da9c-44d8-a38b-b0b30ab513e1 service nova] Creating event network-vif-plugged:9c4e80c0-564e-49e0-b7cf-d9a47b529be5 for instance 6d621fc2-bc77-4d1d-b083-269b49a2133a on hv-cinder-79760 Jul 01 16:50:51.374718 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-d40b7dac-f204-4446-a829-2f4925542f9e req-b29a44b4-da9c-44d8-a38b-b0b30ab513e1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030880 Jul 01 16:50:51.375859 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 492/987] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:50:51.951094 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7d6398ba-3ca7-404d-b348-a0878a0c0e1e tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:50:51.951697 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7d6398ba-3ca7-404d-b348-a0878a0c0e1e tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:50:51.958449 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7d6398ba-3ca7-404d-b348-a0878a0c0e1e tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:51.958899 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7d6398ba-3ca7-404d-b348-a0878a0c0e1e tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:51.959656 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7d6398ba-3ca7-404d-b348-a0878a0c0e1e tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:51.960090 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7d6398ba-3ca7-404d-b348-a0878a0c0e1e tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:52.093563 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7d6398ba-3ca7-404d-b348-a0878a0c0e1e tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:50:52.101054 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7d6398ba-3ca7-404d-b348-a0878a0c0e1e tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a" status: 200 len: 1361 microversion: 2.1 time: 0.153714 Jul 01 16:50:52.102210 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 496/988] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:50:51 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:50:53.120960 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-eb871646-9f2d-4685-beb6-4a22cd13c04b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:50:53.121700 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-eb871646-9f2d-4685-beb6-4a22cd13c04b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:50:53.127984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eb871646-9f2d-4685-beb6-4a22cd13c04b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:53.128429 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eb871646-9f2d-4685-beb6-4a22cd13c04b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:53.129187 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eb871646-9f2d-4685-beb6-4a22cd13c04b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:53.129619 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eb871646-9f2d-4685-beb6-4a22cd13c04b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:53.274724 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-eb871646-9f2d-4685-beb6-4a22cd13c04b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:50:53.283133 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-eb871646-9f2d-4685-beb6-4a22cd13c04b tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a" status: 200 len: 1361 microversion: 2.1 time: 0.167984 Jul 01 16:50:53.283884 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 493/989] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:50:53 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:50:54.300325 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4128433a-1fa9-4847-b7bb-5c91045e1700 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:50:54.300871 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4128433a-1fa9-4847-b7bb-5c91045e1700 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:50:54.303225 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:50:54.303870 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=6 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:50:54.310788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4128433a-1fa9-4847-b7bb-5c91045e1700 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:54.311224 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4128433a-1fa9-4847-b7bb-5c91045e1700 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:54.311975 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4128433a-1fa9-4847-b7bb-5c91045e1700 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:54.312402 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4128433a-1fa9-4847-b7bb-5c91045e1700 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:54.443145 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4128433a-1fa9-4847-b7bb-5c91045e1700 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:50:54.451659 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4128433a-1fa9-4847-b7bb-5c91045e1700 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a" status: 200 len: 1548 microversion: 2.1 time: 0.155258 Jul 01 16:50:54.452224 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 497/990] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:50:54 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:50:54.468175 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-51537778-4d46-42e4-884e-47f1a33cdb74 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:50:54.468674 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-51537778-4d46-42e4-884e-47f1a33cdb74 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:50:54.470603 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=6 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:50:54.476211 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-51537778-4d46-42e4-884e-47f1a33cdb74 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:54.476664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-51537778-4d46-42e4-884e-47f1a33cdb74 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:54.477588 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-51537778-4d46-42e4-884e-47f1a33cdb74 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:54.478029 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-51537778-4d46-42e4-884e-47f1a33cdb74 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:54.559708 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-51537778-4d46-42e4-884e-47f1a33cdb74 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095284 Jul 01 16:50:54.560316 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 494/991] 10.222.0.57 () {58 vars in 1274 bytes} [Fri Jul 1 16:50:54 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:50:55.798693 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-f9e4717d-6d0f-4b0f-890a-0c576570e1ed req-a23a6e4a-2c6f-47f7-af5d-c1253f0028f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d621fc2-bc77-4d1d-b083-269b49a2133a", "tag": "9c4e80c0-564e-49e0-b7cf-d9a47b529be5"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:50:55.807287 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-f9e4717d-6d0f-4b0f-890a-0c576570e1ed req-a23a6e4a-2c6f-47f7-af5d-c1253f0028f6 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:50:55.807728 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-f9e4717d-6d0f-4b0f-890a-0c576570e1ed req-a23a6e4a-2c6f-47f7-af5d-c1253f0028f6 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:50:55.818703 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-f9e4717d-6d0f-4b0f-890a-0c576570e1ed req-a23a6e4a-2c6f-47f7-af5d-c1253f0028f6 service nova] Creating event network-changed:9c4e80c0-564e-49e0-b7cf-d9a47b529be5 for instance 6d621fc2-bc77-4d1d-b083-269b49a2133a on hv-cinder-79760 Jul 01 16:50:55.824400 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-f9e4717d-6d0f-4b0f-890a-0c576570e1ed req-a23a6e4a-2c6f-47f7-af5d-c1253f0028f6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086681 Jul 01 16:50:55.824968 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 498/992] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:51:31.910557 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:51:31.911372 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:51:31.915822 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e66c1e9a-40e7-447c-ad06-785568a81dbe tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:31.916350 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e66c1e9a-40e7-447c-ad06-785568a81dbe tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:31.923772 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e66c1e9a-40e7-447c-ad06-785568a81dbe tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:31.924306 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e66c1e9a-40e7-447c-ad06-785568a81dbe tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:31.925079 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e66c1e9a-40e7-447c-ad06-785568a81dbe tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:31.925519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e66c1e9a-40e7-447c-ad06-785568a81dbe tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:31.950293 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e66c1e9a-40e7-447c-ad06-785568a81dbe tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/ips" status: 200 len: 147 microversion: 2.1 time: 0.041238 Jul 01 16:51:31.950891 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 495/993] 10.222.0.57 () {58 vars in 1247 bytes} [Fri Jul 1 16:51:31 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/ips => generated 147 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:51:33.266604 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:51:33.267355 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=62 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:51:33.272130 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f33bb81f-63c0-42a8-8758-ad3599daaf05 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1d949bb-5942-400b-ba48-82d3349bb2e5"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:51:33.273808 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f33bb81f-63c0-42a8-8758-ad3599daaf05 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:33.281533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f33bb81f-63c0-42a8-8758-ad3599daaf05 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:33.281928 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f33bb81f-63c0-42a8-8758-ad3599daaf05 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:33.282727 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f33bb81f-63c0-42a8-8758-ad3599daaf05 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:33.283165 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f33bb81f-63c0-42a8-8758-ad3599daaf05 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:33.553979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f33bb81f-63c0-42a8-8758-ad3599daaf05 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "POST /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288751 Jul 01 16:51:33.554882 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 499/994] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 1 16:51:33 2022] POST /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:51:34.117863 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0fe3f5b6-87a5-4cfa-b8e6-569bf8675873 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:34.118488 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0fe3f5b6-87a5-4cfa-b8e6-569bf8675873 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: ebc16539-c026-4455-bb75-c1d02f6886b9] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:34.122763 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-46392e6c-ce3e-4155-8b3c-84560352278b req-125155e0-910d-49bd-b474-73d153c5f3c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebc16539-c026-4455-bb75-c1d02f6886b9", "tag": "8ec49325-cc21-4a36-a53e-e056f6781dc9"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:51:34.125661 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0fe3f5b6-87a5-4cfa-b8e6-569bf8675873 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:34.126481 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0fe3f5b6-87a5-4cfa-b8e6-569bf8675873 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:34.127913 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0fe3f5b6-87a5-4cfa-b8e6-569bf8675873 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:34.128720 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0fe3f5b6-87a5-4cfa-b8e6-569bf8675873 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:34.131566 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-46392e6c-ce3e-4155-8b3c-84560352278b req-125155e0-910d-49bd-b474-73d153c5f3c3 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:34.132879 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-46392e6c-ce3e-4155-8b3c-84560352278b req-125155e0-910d-49bd-b474-73d153c5f3c3 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:34.150724 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-46392e6c-ce3e-4155-8b3c-84560352278b req-125155e0-910d-49bd-b474-73d153c5f3c3 service nova] Creating event network-changed:8ec49325-cc21-4a36-a53e-e056f6781dc9 for instance ebc16539-c026-4455-bb75-c1d02f6886b9 on hv-cinder-79760 Jul 01 16:51:34.155796 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-46392e6c-ce3e-4155-8b3c-84560352278b req-125155e0-910d-49bd-b474-73d153c5f3c3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040241 Jul 01 16:51:34.157003 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 500/995] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:51:34.162456 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0fe3f5b6-87a5-4cfa-b8e6-569bf8675873 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: ebc16539-c026-4455-bb75-c1d02f6886b9] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 16:51:34.247999 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0fe3f5b6-87a5-4cfa-b8e6-569bf8675873 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9" status: 204 len: 0 microversion: 2.1 time: 0.135163 Jul 01 16:51:34.249239 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 496/996] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:51:34 2022] DELETE /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 16:51:34.260118 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e0aa5bc3-7cf5-4662-ae48-68c9b5c97de6 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:34.260878 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e0aa5bc3-7cf5-4662-ae48-68c9b5c97de6 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: ebc16539-c026-4455-bb75-c1d02f6886b9] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:34.268130 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e0aa5bc3-7cf5-4662-ae48-68c9b5c97de6 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:34.269214 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e0aa5bc3-7cf5-4662-ae48-68c9b5c97de6 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:34.269986 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e0aa5bc3-7cf5-4662-ae48-68c9b5c97de6 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:34.270468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e0aa5bc3-7cf5-4662-ae48-68c9b5c97de6 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:34.420226 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e0aa5bc3-7cf5-4662-ae48-68c9b5c97de6 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:51:34.428187 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e0aa5bc3-7cf5-4662-ae48-68c9b5c97de6 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9" status: 200 len: 1576 microversion: 2.1 time: 0.174116 Jul 01 16:51:34.429473 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 501/997] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:51:34 2022] GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:51:35.462298 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ae0e0bd9-d9de-47bc-8e53-64cca50f024d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:35.462949 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ae0e0bd9-d9de-47bc-8e53-64cca50f024d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: ebc16539-c026-4455-bb75-c1d02f6886b9] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:35.469410 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ae0e0bd9-d9de-47bc-8e53-64cca50f024d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:35.469860 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ae0e0bd9-d9de-47bc-8e53-64cca50f024d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:35.470665 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ae0e0bd9-d9de-47bc-8e53-64cca50f024d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:35.471119 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ae0e0bd9-d9de-47bc-8e53-64cca50f024d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:35.603823 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ae0e0bd9-d9de-47bc-8e53-64cca50f024d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:51:35.611347 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ae0e0bd9-d9de-47bc-8e53-64cca50f024d tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9" status: 200 len: 1576 microversion: 2.1 time: 0.154430 Jul 01 16:51:35.611918 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 497/998] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:51:35 2022] GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:51:36.628289 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4f6b69fb-8ca6-43fa-9dc3-866d3c03058b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:36.628925 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4f6b69fb-8ca6-43fa-9dc3-866d3c03058b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: ebc16539-c026-4455-bb75-c1d02f6886b9] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:36.636361 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4f6b69fb-8ca6-43fa-9dc3-866d3c03058b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:36.636801 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4f6b69fb-8ca6-43fa-9dc3-866d3c03058b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:36.637549 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4f6b69fb-8ca6-43fa-9dc3-866d3c03058b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:36.637979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4f6b69fb-8ca6-43fa-9dc3-866d3c03058b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:36.862418 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4f6b69fb-8ca6-43fa-9dc3-866d3c03058b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:51:36.875678 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4f6b69fb-8ca6-43fa-9dc3-866d3c03058b tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9" status: 200 len: 1576 microversion: 2.1 time: 0.251155 Jul 01 16:51:36.876459 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 502/999] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:51:36 2022] GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9 => generated 1576 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:51:37.343822 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-c58cf364-e43b-4543-bfc5-f748e5131687 req-e6ef4b4d-f2bc-4934-b38f-bfabefd8cf0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebc16539-c026-4455-bb75-c1d02f6886b9", "name": "network-vif-deleted", "tag": "8ec49325-cc21-4a36-a53e-e056f6781dc9"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:51:37.354096 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-c58cf364-e43b-4543-bfc5-f748e5131687 req-e6ef4b4d-f2bc-4934-b38f-bfabefd8cf0a service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:37.354615 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-c58cf364-e43b-4543-bfc5-f748e5131687 req-e6ef4b4d-f2bc-4934-b38f-bfabefd8cf0a service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:37.365928 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-c58cf364-e43b-4543-bfc5-f748e5131687 req-e6ef4b4d-f2bc-4934-b38f-bfabefd8cf0a service nova] Creating event network-vif-deleted:8ec49325-cc21-4a36-a53e-e056f6781dc9 for instance ebc16539-c026-4455-bb75-c1d02f6886b9 on hv-cinder-79760 Jul 01 16:51:37.371211 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-c58cf364-e43b-4543-bfc5-f748e5131687 req-e6ef4b4d-f2bc-4934-b38f-bfabefd8cf0a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095988 Jul 01 16:51:37.371802 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 498/1000] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:51:37.888831 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e5a8f9fc-1c5d-4d36-a067-7a8e7ee24ee7 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:37.889816 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e5a8f9fc-1c5d-4d36-a067-7a8e7ee24ee7 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:37.894821 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-723740dd-0da0-4cfd-96da-bf290b3655c0 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:37.896170 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-723740dd-0da0-4cfd-96da-bf290b3655c0 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: ebc16539-c026-4455-bb75-c1d02f6886b9] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:37.896367 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e5a8f9fc-1c5d-4d36-a067-7a8e7ee24ee7 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:37.896815 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e5a8f9fc-1c5d-4d36-a067-7a8e7ee24ee7 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:37.897816 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e5a8f9fc-1c5d-4d36-a067-7a8e7ee24ee7 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:37.898252 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e5a8f9fc-1c5d-4d36-a067-7a8e7ee24ee7 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:37.905098 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-723740dd-0da0-4cfd-96da-bf290b3655c0 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:37.905547 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-723740dd-0da0-4cfd-96da-bf290b3655c0 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:37.906316 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-723740dd-0da0-4cfd-96da-bf290b3655c0 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:37.906780 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-723740dd-0da0-4cfd-96da-bf290b3655c0 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:37.927261 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e5a8f9fc-1c5d-4d36-a067-7a8e7ee24ee7 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042332 Jul 01 16:51:37.928071 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 503/1001] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 1 16:51:37 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:51:37.938074 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2b2f52e9-d74d-4356-83a5-e7993b9c7981 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:37.938585 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2b2f52e9-d74d-4356-83a5-e7993b9c7981 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:37.940640 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-723740dd-0da0-4cfd-96da-bf290b3655c0 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:37.941098 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-723740dd-0da0-4cfd-96da-bf290b3655c0 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:37.941542 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-723740dd-0da0-4cfd-96da-bf290b3655c0 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lazy-loading 'fault' on Instance uuid ebc16539-c026-4455-bb75-c1d02f6886b9 {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:51:37.945037 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2b2f52e9-d74d-4356-83a5-e7993b9c7981 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:37.945488 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2b2f52e9-d74d-4356-83a5-e7993b9c7981 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:37.946287 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2b2f52e9-d74d-4356-83a5-e7993b9c7981 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:37.946755 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2b2f52e9-d74d-4356-83a5-e7993b9c7981 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:37.975790 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2b2f52e9-d74d-4356-83a5-e7993b9c7981 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-volume_attachments/e1d949bb-5942-400b-ba48-82d3349bb2e5" status: 200 len: 194 microversion: 2.1 time: 0.041321 Jul 01 16:51:37.976644 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 504/1002] 10.222.0.57 () {58 vars in 1412 bytes} [Fri Jul 1 16:51:37 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-volume_attachments/e1d949bb-5942-400b-ba48-82d3349bb2e5 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:51:37.986662 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-723740dd-0da0-4cfd-96da-bf290b3655c0 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:51:37.995347 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-723740dd-0da0-4cfd-96da-bf290b3655c0 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9" status: 200 len: 1229 microversion: 2.1 time: 0.105545 Jul 01 16:51:38.002742 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 499/1003] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:51:37 2022] GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9 => generated 1229 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:51:39.013423 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-dba4db39-5150-40c0-932f-e914c48b40a5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:39.014009 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-dba4db39-5150-40c0-932f-e914c48b40a5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: ebc16539-c026-4455-bb75-c1d02f6886b9] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:39.020462 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dba4db39-5150-40c0-932f-e914c48b40a5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:39.020907 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dba4db39-5150-40c0-932f-e914c48b40a5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:39.021662 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dba4db39-5150-40c0-932f-e914c48b40a5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:39.023630 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dba4db39-5150-40c0-932f-e914c48b40a5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:39.039409 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-dba4db39-5150-40c0-932f-e914c48b40a5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] HTTP exception thrown: Instance ebc16539-c026-4455-bb75-c1d02f6886b9 could not be found. Jul 01 16:51:39.041041 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-dba4db39-5150-40c0-932f-e914c48b40a5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Request method failure captured: Jul 01 16:51:39.041041 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9 HTTP/1.1 Jul 01 16:51:39.041041 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:51:39.041041 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:51:39.041041 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:51:39.041041 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:51:39.041041 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:51:39.041041 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:51:39.041041 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:51:39.041041 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:51:39.041041 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyR2f7LALLfskMHzaraFmTet8fc6f3bA_U7WB7hc6U08q8CvC6xG4MIs1HcRGKmZCbM0QSAKhLe3aT4Bhe6Br51vmkqnjbura-I2XEvTxze7G4otey9C2tKS0ML0IGXXFV9qJ8wNGpPlMfyAOc3q27lFGOTRDGwsGh_8oeqn3mAGZwY Jul 01 16:51:39.041041 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:51:39.041041 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:51:39.041041 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:51:39.041041 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:51:39.041041 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:51:39.041041 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:51:39.041041 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: 0076c4e65bce4bd58478d09d62607981 Jul 01 16:51:39.041041 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-TestVolumeBootPattern-262431778 Jul 01 16:51:39.041041 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:51:39.041041 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:51:39.042764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0076c4e65bce4bd58478d09d62607981"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0076c4e65bce4bd58478d09d62607981"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0076c4e65bce4bd58478d09d62607981"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0076c4e65bce4bd58478d09d62607981"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:51:39.042764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-TestVolumeBootPattern-262431778 Jul 01 16:51:39.042764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 0076c4e65bce4bd58478d09d62607981 Jul 01 16:51:39.042764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-TestVolumeBootPattern-262431778 Jul 01 16:51:39.042764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-TestVolumeBootPattern-262431778-project Jul 01 16:51:39.042764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:51:39.042764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:51:39.042764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: d6589e2636dd46838a3a0c66d18e0d00 Jul 01 16:51:39.042764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-TestVolumeBootPattern-262431778-project Jul 01 16:51:39.042764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:51:39.042764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance ebc16539-c026-4455-bb75-c1d02f6886b9 could not be found. Jul 01 16:51:39.042764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': 'ebc16539-c026-4455-bb75-c1d02f6886b9'} Jul 01 16:51:39.043661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:51:39.043661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:51:39.043661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:51:39.043661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:51:39.043661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:51:39.043661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:51:39.043661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:51:39.043661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:51:39.043661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:51:39.043661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:51:39.043661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebc16539-c026-4455-bb75-c1d02f6886b9 could not be found. Jul 01 16:51:39.043661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:39.043661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:51:39.043661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:39.043661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:51:39.043661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:51:39.043661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:51:39.043661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:51:39.043661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:51:39.043661 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:51:39.045199 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:51:39.045199 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:51:39.045199 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:51:39.045199 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:51:39.045199 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:51:39.045199 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:51:39.045199 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:51:39.045199 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebc16539-c026-4455-bb75-c1d02f6886b9 could not be found. Jul 01 16:51:39.045199 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:39.045199 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:51:39.045199 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:39.045199 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:51:39.045199 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:51:39.045199 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:51:39.045199 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:51:39.045199 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:51:39.045199 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebc16539-c026-4455-bb75-c1d02f6886b9 could not be found. Jul 01 16:51:39.045199 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:39.046671 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-dba4db39-5150-40c0-932f-e914c48b40a5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Returning 404 to user: Instance ebc16539-c026-4455-bb75-c1d02f6886b9 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:51:39.046671 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-dba4db39-5150-40c0-932f-e914c48b40a5 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9" status: 404 len: 111 microversion: 2.1 time: 0.033320 Jul 01 16:51:39.046671 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 505/1004] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:51:39 2022] GET /compute/v2.1/servers/ebc16539-c026-4455-bb75-c1d02f6886b9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:51:39.300976 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6f8b90f4-ac37-48b5-b7c7-5ba83303f9d9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94ba5334-b543-4e7b-9977-d6e54e9099ba"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:51:39.302038 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6f8b90f4-ac37-48b5-b7c7-5ba83303f9d9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:39.309134 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6f8b90f4-ac37-48b5-b7c7-5ba83303f9d9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:39.309578 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6f8b90f4-ac37-48b5-b7c7-5ba83303f9d9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:39.310363 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6f8b90f4-ac37-48b5-b7c7-5ba83303f9d9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:39.310804 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6f8b90f4-ac37-48b5-b7c7-5ba83303f9d9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:39.586221 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6f8b90f4-ac37-48b5-b7c7-5ba83303f9d9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "POST /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288996 Jul 01 16:51:39.586874 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 500/1005] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 1 16:51:39 2022] POST /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:51:42.134658 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-bfea58d3-0d97-4b03-96ca-e91763ff248c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:42.135280 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-bfea58d3-0d97-4b03-96ca-e91763ff248c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:42.136754 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-2bac6a51-2f42-457f-b0bd-685f644dc256 req-2c38342f-f9d6-4532-b7c6-097179daf946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e", "tag": "b189e3e5-619a-4eff-907c-88d68b95600f"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:51:42.141860 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bfea58d3-0d97-4b03-96ca-e91763ff248c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:42.142457 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bfea58d3-0d97-4b03-96ca-e91763ff248c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:42.143325 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bfea58d3-0d97-4b03-96ca-e91763ff248c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:42.143863 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bfea58d3-0d97-4b03-96ca-e91763ff248c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:42.147319 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-2bac6a51-2f42-457f-b0bd-685f644dc256 req-2c38342f-f9d6-4532-b7c6-097179daf946 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:42.147976 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-2bac6a51-2f42-457f-b0bd-685f644dc256 req-2c38342f-f9d6-4532-b7c6-097179daf946 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:42.159699 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-2bac6a51-2f42-457f-b0bd-685f644dc256 req-2c38342f-f9d6-4532-b7c6-097179daf946 service nova] Creating event network-changed:b189e3e5-619a-4eff-907c-88d68b95600f for instance c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e on hv-cinder-79760 Jul 01 16:51:42.165588 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-2bac6a51-2f42-457f-b0bd-685f644dc256 req-2c38342f-f9d6-4532-b7c6-097179daf946 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032692 Jul 01 16:51:42.166173 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 501/1006] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:51:42.171630 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-bfea58d3-0d97-4b03-96ca-e91763ff248c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] Going to try to terminate instance {{(pid=124317) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 16:51:42.266492 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-bfea58d3-0d97-4b03-96ca-e91763ff248c tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e" status: 204 len: 0 microversion: 2.1 time: 0.135829 Jul 01 16:51:42.267460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 506/1007] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:51:42 2022] DELETE /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 16:51:42.276949 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-796f8306-90a1-445a-b8dd-bd07a00e1043 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:42.277435 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-796f8306-90a1-445a-b8dd-bd07a00e1043 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:42.283880 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-796f8306-90a1-445a-b8dd-bd07a00e1043 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:42.284397 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-796f8306-90a1-445a-b8dd-bd07a00e1043 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:42.285245 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-796f8306-90a1-445a-b8dd-bd07a00e1043 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:42.285786 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-796f8306-90a1-445a-b8dd-bd07a00e1043 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:42.433911 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-796f8306-90a1-445a-b8dd-bd07a00e1043 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:51:42.441767 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-796f8306-90a1-445a-b8dd-bd07a00e1043 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e" status: 200 len: 1577 microversion: 2.1 time: 0.169844 Jul 01 16:51:42.442437 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 502/1008] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:51:42 2022] GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:51:43.461486 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-27dfa493-bb7f-466e-a426-cfe354e5d061 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:43.462191 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-27dfa493-bb7f-466e-a426-cfe354e5d061 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:43.469026 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-27dfa493-bb7f-466e-a426-cfe354e5d061 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:43.469483 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-27dfa493-bb7f-466e-a426-cfe354e5d061 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:43.470252 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-27dfa493-bb7f-466e-a426-cfe354e5d061 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:43.470722 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-27dfa493-bb7f-466e-a426-cfe354e5d061 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:43.601245 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-27dfa493-bb7f-466e-a426-cfe354e5d061 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:51:43.608963 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-27dfa493-bb7f-466e-a426-cfe354e5d061 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e" status: 200 len: 1577 microversion: 2.1 time: 0.152259 Jul 01 16:51:43.609532 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 507/1009] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:51:43 2022] GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:51:44.626746 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5c956312-aeee-4bbe-a78a-08777eb5e5dd tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:44.627306 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5c956312-aeee-4bbe-a78a-08777eb5e5dd tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:44.634668 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5c956312-aeee-4bbe-a78a-08777eb5e5dd tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:44.635170 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5c956312-aeee-4bbe-a78a-08777eb5e5dd tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:44.635940 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5c956312-aeee-4bbe-a78a-08777eb5e5dd tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:44.636377 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5c956312-aeee-4bbe-a78a-08777eb5e5dd tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:44.728133 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5c956312-aeee-4bbe-a78a-08777eb5e5dd tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:51:44.729244 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-3ae578df-847d-4c40-ae0b-2e1e3c981c8b req-32aeacb3-5c1b-45b8-b947-2c869cc6c825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e", "name": "network-vif-deleted", "tag": "b189e3e5-619a-4eff-907c-88d68b95600f"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:51:44.738935 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-3ae578df-847d-4c40-ae0b-2e1e3c981c8b req-32aeacb3-5c1b-45b8-b947-2c869cc6c825 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:44.739734 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-3ae578df-847d-4c40-ae0b-2e1e3c981c8b req-32aeacb3-5c1b-45b8-b947-2c869cc6c825 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:44.740081 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5c956312-aeee-4bbe-a78a-08777eb5e5dd tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e" status: 200 len: 1390 microversion: 2.1 time: 0.117256 Jul 01 16:51:44.740734 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 503/1010] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:51:44 2022] GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e => generated 1390 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:51:44.752372 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-3ae578df-847d-4c40-ae0b-2e1e3c981c8b req-32aeacb3-5c1b-45b8-b947-2c869cc6c825 service nova] Creating event network-vif-deleted:b189e3e5-619a-4eff-907c-88d68b95600f for instance c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e on hv-cinder-79760 Jul 01 16:51:44.757659 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-3ae578df-847d-4c40-ae0b-2e1e3c981c8b req-32aeacb3-5c1b-45b8-b947-2c869cc6c825 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033866 Jul 01 16:51:44.758212 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 508/1011] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:51:45.757245 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-53cb736c-13c4-4eda-a20c-3c30fd700cfa tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:45.757832 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-53cb736c-13c4-4eda-a20c-3c30fd700cfa tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:45.764192 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-53cb736c-13c4-4eda-a20c-3c30fd700cfa tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:45.764635 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-53cb736c-13c4-4eda-a20c-3c30fd700cfa tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:45.765384 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-53cb736c-13c4-4eda-a20c-3c30fd700cfa tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:45.765812 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-53cb736c-13c4-4eda-a20c-3c30fd700cfa tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:45.796251 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-53cb736c-13c4-4eda-a20c-3c30fd700cfa tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:45.796695 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-53cb736c-13c4-4eda-a20c-3c30fd700cfa tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:45.797135 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-53cb736c-13c4-4eda-a20c-3c30fd700cfa tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lazy-loading 'fault' on Instance uuid c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:51:45.839446 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-53cb736c-13c4-4eda-a20c-3c30fd700cfa tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6589e2636dd46838a3a0c66d18e0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0076c4e65bce4bd58478d09d62607981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:51:45.847008 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-53cb736c-13c4-4eda-a20c-3c30fd700cfa tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e" status: 200 len: 1230 microversion: 2.1 time: 0.093893 Jul 01 16:51:45.847567 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 504/1012] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:51:45 2022] GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:51:46.865282 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c684d3c3-ac59-452d-992c-e091297f04b4 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:46.865983 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c684d3c3-ac59-452d-992c-e091297f04b4 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:46.873112 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c684d3c3-ac59-452d-992c-e091297f04b4 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:46.873557 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c684d3c3-ac59-452d-992c-e091297f04b4 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:46.874323 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c684d3c3-ac59-452d-992c-e091297f04b4 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:46.874779 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c684d3c3-ac59-452d-992c-e091297f04b4 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:46.888442 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-c684d3c3-ac59-452d-992c-e091297f04b4 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] HTTP exception thrown: Instance c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e could not be found. Jul 01 16:51:46.890120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c684d3c3-ac59-452d-992c-e091297f04b4 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Request method failure captured: Jul 01 16:51:46.890120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e HTTP/1.1 Jul 01 16:51:46.890120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:51:46.890120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:51:46.890120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:51:46.890120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:51:46.890120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:51:46.890120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:51:46.890120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:51:46.890120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:51:46.890120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyR2f7LALLfskMHzaraFmTet8fc6f3bA_U7WB7hc6U08q8CvC6xG4MIs1HcRGKmZCbM0QSAKhLe3aT4Bhe6Br51vmkqnjbura-I2XEvTxze7G4otey9C2tKS0ML0IGXXFV9qJ8wNGpPlMfyAOc3q27lFGOTRDGwsGh_8oeqn3mAGZwY Jul 01 16:51:46.890120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:51:46.890120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:51:46.890120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:51:46.890120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:51:46.890120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:51:46.890120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:51:46.890120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: 0076c4e65bce4bd58478d09d62607981 Jul 01 16:51:46.890120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-TestVolumeBootPattern-262431778 Jul 01 16:51:46.890120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:51:46.890120 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:51:46.891764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0076c4e65bce4bd58478d09d62607981"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0076c4e65bce4bd58478d09d62607981"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0076c4e65bce4bd58478d09d62607981"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0076c4e65bce4bd58478d09d62607981"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:51:46.891764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-TestVolumeBootPattern-262431778 Jul 01 16:51:46.891764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 0076c4e65bce4bd58478d09d62607981 Jul 01 16:51:46.891764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-TestVolumeBootPattern-262431778 Jul 01 16:51:46.891764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-TestVolumeBootPattern-262431778-project Jul 01 16:51:46.891764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:51:46.891764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:51:46.891764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: d6589e2636dd46838a3a0c66d18e0d00 Jul 01 16:51:46.891764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-TestVolumeBootPattern-262431778-project Jul 01 16:51:46.891764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:51:46.891764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e could not be found. Jul 01 16:51:46.891764 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': 'c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e'} Jul 01 16:51:46.892666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:51:46.892666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:51:46.892666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:51:46.892666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:51:46.892666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:51:46.892666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:51:46.892666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:51:46.892666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:51:46.892666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:51:46.892666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:51:46.892666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e could not be found. Jul 01 16:51:46.892666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:46.892666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:51:46.892666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:46.892666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:51:46.892666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:51:46.892666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:51:46.892666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:51:46.892666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:51:46.892666 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:51:46.894114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:51:46.894114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:51:46.894114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:51:46.894114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:51:46.894114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:51:46.894114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:51:46.894114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:51:46.894114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e could not be found. Jul 01 16:51:46.894114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:46.894114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:51:46.894114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:46.894114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:51:46.894114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:51:46.894114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:51:46.894114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:51:46.894114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:51:46.894114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e could not be found. Jul 01 16:51:46.894114 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:46.895472 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c684d3c3-ac59-452d-992c-e091297f04b4 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Returning 404 to user: Instance c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:51:46.895472 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c684d3c3-ac59-452d-992c-e091297f04b4 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e" status: 404 len: 111 microversion: 2.1 time: 0.031049 Jul 01 16:51:46.895472 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 509/1013] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:51:46 2022] GET /compute/v2.1/servers/c50f55c8-c1e5-4d5f-aa7c-61bbf412b71e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:51:47.084948 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2132a5e5-74f7-4e8d-b70c-fc3eb083d062 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:47.085985 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2132a5e5-74f7-4e8d-b70c-fc3eb083d062 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:47.092516 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2132a5e5-74f7-4e8d-b70c-fc3eb083d062 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:47.093025 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2132a5e5-74f7-4e8d-b70c-fc3eb083d062 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:47.093804 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2132a5e5-74f7-4e8d-b70c-fc3eb083d062 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:47.094248 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2132a5e5-74f7-4e8d-b70c-fc3eb083d062 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:47.126679 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2132a5e5-74f7-4e8d-b70c-fc3eb083d062 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046044 Jul 01 16:51:47.127250 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 505/1014] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 1 16:51:47 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:51:47.288406 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a55a3264-0cef-441e-b98f-ab99d04e3d1c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:47.289675 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a55a3264-0cef-441e-b98f-ab99d04e3d1c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:47.296081 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a55a3264-0cef-441e-b98f-ab99d04e3d1c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:47.296625 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a55a3264-0cef-441e-b98f-ab99d04e3d1c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:47.297467 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a55a3264-0cef-441e-b98f-ab99d04e3d1c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:47.297998 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a55a3264-0cef-441e-b98f-ab99d04e3d1c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:47.328920 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a55a3264-0cef-441e-b98f-ab99d04e3d1c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-volume_attachments/e1d949bb-5942-400b-ba48-82d3349bb2e5" status: 200 len: 194 microversion: 2.1 time: 0.046717 Jul 01 16:51:47.329525 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 510/1015] 10.222.0.57 () {58 vars in 1412 bytes} [Fri Jul 1 16:51:47 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-volume_attachments/e1d949bb-5942-400b-ba48-82d3349bb2e5 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:51:47.341312 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1e6a6477-8113-4ae3-8286-64856a86d391 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:47.341859 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1e6a6477-8113-4ae3-8286-64856a86d391 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:47.347946 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1e6a6477-8113-4ae3-8286-64856a86d391 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:47.348398 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1e6a6477-8113-4ae3-8286-64856a86d391 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:47.349173 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1e6a6477-8113-4ae3-8286-64856a86d391 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:47.349609 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1e6a6477-8113-4ae3-8286-64856a86d391 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:47.354324 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-de6f37bb-2fd1-4d2d-a953-719d623d2402 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:47.354874 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-de6f37bb-2fd1-4d2d-a953-719d623d2402 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:47.360932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-de6f37bb-2fd1-4d2d-a953-719d623d2402 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:47.361380 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-de6f37bb-2fd1-4d2d-a953-719d623d2402 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:47.362236 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-de6f37bb-2fd1-4d2d-a953-719d623d2402 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:47.362725 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-de6f37bb-2fd1-4d2d-a953-719d623d2402 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:47.378613 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-de6f37bb-2fd1-4d2d-a953-719d623d2402 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] HTTP exception thrown: Instance 33ee3ade-fd90-45c3-aa1c-d204a509deae could not be found. Jul 01 16:51:47.380344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-de6f37bb-2fd1-4d2d-a953-719d623d2402 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Request method failure captured: Jul 01 16:51:47.380344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: DELETE /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae HTTP/1.1 Jul 01 16:51:47.380344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:51:47.380344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:51:47.380344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:51:47.380344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:51:47.380344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:51:47.380344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:51:47.380344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:51:47.380344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:51:47.380344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyR2f7LALLfskMHzaraFmTet8fc6f3bA_U7WB7hc6U08q8CvC6xG4MIs1HcRGKmZCbM0QSAKhLe3aT4Bhe6Br51vmkqnjbura-I2XEvTxze7G4otey9C2tKS0ML0IGXXFV9qJ8wNGpPlMfyAOc3q27lFGOTRDGwsGh_8oeqn3mAGZwY Jul 01 16:51:47.380344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:51:47.380344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:51:47.380344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:51:47.380344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:51:47.380344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:51:47.380344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:51:47.380344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: 0076c4e65bce4bd58478d09d62607981 Jul 01 16:51:47.380344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-TestVolumeBootPattern-262431778 Jul 01 16:51:47.380344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:51:47.380344 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:51:47.383124 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0076c4e65bce4bd58478d09d62607981"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0076c4e65bce4bd58478d09d62607981"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0076c4e65bce4bd58478d09d62607981"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0076c4e65bce4bd58478d09d62607981"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:51:47.383124 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-TestVolumeBootPattern-262431778 Jul 01 16:51:47.383124 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 0076c4e65bce4bd58478d09d62607981 Jul 01 16:51:47.383124 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-TestVolumeBootPattern-262431778 Jul 01 16:51:47.383124 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-TestVolumeBootPattern-262431778-project Jul 01 16:51:47.383124 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:51:47.383124 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:51:47.383124 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: d6589e2636dd46838a3a0c66d18e0d00 Jul 01 16:51:47.383124 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-TestVolumeBootPattern-262431778-project Jul 01 16:51:47.383124 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:51:47.383124 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance 33ee3ade-fd90-45c3-aa1c-d204a509deae could not be found. Jul 01 16:51:47.383124 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': '33ee3ade-fd90-45c3-aa1c-d204a509deae'} Jul 01 16:51:47.384274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:51:47.384274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:51:47.384274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:51:47.384274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:51:47.384274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:51:47.384274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:51:47.384274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:51:47.384274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:51:47.384274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:51:47.384274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:51:47.384274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33ee3ade-fd90-45c3-aa1c-d204a509deae could not be found. Jul 01 16:51:47.384274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:47.384274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:51:47.384274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:47.384274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:51:47.384274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:51:47.384274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:51:47.384274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:51:47.384274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:51:47.384274 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:51:47.385778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:51:47.385778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 16:51:47.385778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 16:51:47.385778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 16:51:47.385778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 16:51:47.385778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:51:47.385778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:51:47.385778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:51:47.385778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:51:47.385778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33ee3ade-fd90-45c3-aa1c-d204a509deae could not be found. Jul 01 16:51:47.385778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:47.385778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:51:47.385778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:47.385778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:51:47.385778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:51:47.385778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:51:47.385778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:51:47.385778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:51:47.385778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33ee3ade-fd90-45c3-aa1c-d204a509deae could not be found. Jul 01 16:51:47.385778 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:47.387539 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-de6f37bb-2fd1-4d2d-a953-719d623d2402 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Returning 404 to user: Instance 33ee3ade-fd90-45c3-aa1c-d204a509deae could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:51:47.387539 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-de6f37bb-2fd1-4d2d-a953-719d623d2402 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "DELETE /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 404 len: 111 microversion: 2.1 time: 0.031872 Jul 01 16:51:47.387539 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 511/1016] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:51:47 2022] DELETE /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 16:51:47.392126 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f4ecb547-8b55-4617-8dfb-4d756941c5bb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:47.392979 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f4ecb547-8b55-4617-8dfb-4d756941c5bb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] [instance: 33ee3ade-fd90-45c3-aa1c-d204a509deae] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:47.401628 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f4ecb547-8b55-4617-8dfb-4d756941c5bb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:47.402093 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f4ecb547-8b55-4617-8dfb-4d756941c5bb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:47.402902 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f4ecb547-8b55-4617-8dfb-4d756941c5bb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:47.403342 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f4ecb547-8b55-4617-8dfb-4d756941c5bb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:47.417178 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-f4ecb547-8b55-4617-8dfb-4d756941c5bb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] HTTP exception thrown: Instance 33ee3ade-fd90-45c3-aa1c-d204a509deae could not be found. Jul 01 16:51:47.418749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f4ecb547-8b55-4617-8dfb-4d756941c5bb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Request method failure captured: Jul 01 16:51:47.418749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae HTTP/1.1 Jul 01 16:51:47.418749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:51:47.418749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:51:47.418749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:51:47.418749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:51:47.418749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:51:47.418749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:51:47.418749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:51:47.418749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:51:47.418749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyR2f7LALLfskMHzaraFmTet8fc6f3bA_U7WB7hc6U08q8CvC6xG4MIs1HcRGKmZCbM0QSAKhLe3aT4Bhe6Br51vmkqnjbura-I2XEvTxze7G4otey9C2tKS0ML0IGXXFV9qJ8wNGpPlMfyAOc3q27lFGOTRDGwsGh_8oeqn3mAGZwY Jul 01 16:51:47.418749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:51:47.418749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:51:47.418749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:51:47.418749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:51:47.418749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:51:47.418749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:51:47.418749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: 0076c4e65bce4bd58478d09d62607981 Jul 01 16:51:47.418749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-TestVolumeBootPattern-262431778 Jul 01 16:51:47.418749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:51:47.418749 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:51:47.420164 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0076c4e65bce4bd58478d09d62607981"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0076c4e65bce4bd58478d09d62607981"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0076c4e65bce4bd58478d09d62607981"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0076c4e65bce4bd58478d09d62607981"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:51:47.420164 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-TestVolumeBootPattern-262431778 Jul 01 16:51:47.420164 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 0076c4e65bce4bd58478d09d62607981 Jul 01 16:51:47.420164 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-TestVolumeBootPattern-262431778 Jul 01 16:51:47.420164 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-TestVolumeBootPattern-262431778-project Jul 01 16:51:47.420164 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:51:47.420164 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:51:47.420164 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: d6589e2636dd46838a3a0c66d18e0d00 Jul 01 16:51:47.420164 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-TestVolumeBootPattern-262431778-project Jul 01 16:51:47.420164 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:51:47.420164 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance 33ee3ade-fd90-45c3-aa1c-d204a509deae could not be found. Jul 01 16:51:47.420164 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': '33ee3ade-fd90-45c3-aa1c-d204a509deae'} Jul 01 16:51:47.420918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:51:47.420918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:51:47.420918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:51:47.420918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:51:47.420918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:51:47.420918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:51:47.420918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:51:47.420918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:51:47.420918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:51:47.420918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:51:47.420918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33ee3ade-fd90-45c3-aa1c-d204a509deae could not be found. Jul 01 16:51:47.420918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:47.420918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:51:47.420918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:47.420918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:51:47.420918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:51:47.420918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:51:47.420918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:51:47.420918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:51:47.420918 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:51:47.422178 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:51:47.422178 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:51:47.422178 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:51:47.422178 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:51:47.422178 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:51:47.422178 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:51:47.422178 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:51:47.422178 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33ee3ade-fd90-45c3-aa1c-d204a509deae could not be found. Jul 01 16:51:47.422178 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:47.422178 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:51:47.422178 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:47.422178 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:51:47.422178 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:51:47.422178 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:51:47.422178 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:51:47.422178 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:51:47.422178 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33ee3ade-fd90-45c3-aa1c-d204a509deae could not be found. Jul 01 16:51:47.422178 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:47.423533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f4ecb547-8b55-4617-8dfb-4d756941c5bb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Returning 404 to user: Instance 33ee3ade-fd90-45c3-aa1c-d204a509deae could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:51:47.423533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f4ecb547-8b55-4617-8dfb-4d756941c5bb tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae" status: 404 len: 111 microversion: 2.1 time: 0.033097 Jul 01 16:51:47.423533 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 512/1017] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:51:47 2022] GET /compute/v2.1/servers/33ee3ade-fd90-45c3-aa1c-d204a509deae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:51:47.437108 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-1e6a6477-8113-4ae3-8286-64856a86d391 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lazy-loading 'services' on Instance uuid 6d621fc2-bc77-4d1d-b083-269b49a2133a {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:51:47.538057 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1e6a6477-8113-4ae3-8286-64856a86d391 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-volume_attachments/e1d949bb-5942-400b-ba48-82d3349bb2e5" status: 202 len: 0 microversion: 2.1 time: 0.200335 Jul 01 16:51:47.538709 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 506/1018] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 1 16:51:47 2022] DELETE /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-volume_attachments/e1d949bb-5942-400b-ba48-82d3349bb2e5 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:51:48.738318 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d4d98747-6708-4666-9139-d9430d440630 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] Calling method '.version_select at 0x7fa86c5234c0>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:48.761544 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d4d98747-6708-4666-9139-d9430d440630 tempest-TestVolumeBootPattern-262431778 tempest-TestVolumeBootPattern-262431778-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-611014614" status: 202 len: 0 microversion: 2.1 time: 0.029136 Jul 01 16:51:48.762117 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 513/1019] 10.222.0.57 () {58 vars in 1259 bytes} [Fri Jul 1 16:51:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-611014614 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:51:49.722082 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cdfdef31-ebe7-4fea-b095-a74d8f48b3c3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:49.722719 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-cdfdef31-ebe7-4fea-b095-a74d8f48b3c3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:49.729420 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cdfdef31-ebe7-4fea-b095-a74d8f48b3c3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:49.731568 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cdfdef31-ebe7-4fea-b095-a74d8f48b3c3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:49.731568 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cdfdef31-ebe7-4fea-b095-a74d8f48b3c3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:49.731568 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cdfdef31-ebe7-4fea-b095-a74d8f48b3c3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:49.759741 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-cdfdef31-ebe7-4fea-b095-a74d8f48b3c3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-volume_attachments/94ba5334-b543-4e7b-9977-d6e54e9099ba" status: 200 len: 194 microversion: 2.1 time: 0.042459 Jul 01 16:51:49.760524 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 507/1020] 10.222.0.57 () {58 vars in 1412 bytes} [Fri Jul 1 16:51:49 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-volume_attachments/94ba5334-b543-4e7b-9977-d6e54e9099ba => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:51:49.770840 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b1e6e9e0-e8a9-4478-b087-d50329389de3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:49.771401 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b1e6e9e0-e8a9-4478-b087-d50329389de3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:49.779396 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b1e6e9e0-e8a9-4478-b087-d50329389de3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:49.780218 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b1e6e9e0-e8a9-4478-b087-d50329389de3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:49.781231 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b1e6e9e0-e8a9-4478-b087-d50329389de3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:49.781891 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b1e6e9e0-e8a9-4478-b087-d50329389de3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:49.864976 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-b1e6e9e0-e8a9-4478-b087-d50329389de3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lazy-loading 'services' on Instance uuid 6d621fc2-bc77-4d1d-b083-269b49a2133a {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:51:49.940673 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b1e6e9e0-e8a9-4478-b087-d50329389de3 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-volume_attachments/94ba5334-b543-4e7b-9977-d6e54e9099ba" status: 202 len: 0 microversion: 2.1 time: 0.174220 Jul 01 16:51:49.941271 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 514/1021] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 1 16:51:49 2022] DELETE /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-volume_attachments/94ba5334-b543-4e7b-9977-d6e54e9099ba => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:51:51.147408 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1ff08b33-563d-43d8-808f-14cfde82ccd9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:51.148981 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1ff08b33-563d-43d8-808f-14cfde82ccd9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:51.155392 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1ff08b33-563d-43d8-808f-14cfde82ccd9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:51.155895 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1ff08b33-563d-43d8-808f-14cfde82ccd9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:51.156928 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1ff08b33-563d-43d8-808f-14cfde82ccd9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:51.157428 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1ff08b33-563d-43d8-808f-14cfde82ccd9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:51.186854 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:51:51.192163 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1ff08b33-563d-43d8-808f-14cfde82ccd9 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048907 Jul 01 16:51:51.192780 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 508/1022] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 1 16:51:51 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 16:51:51.322231 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-66b49f92-0ebc-469a-b6ac-62a292c117bc tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:51.323843 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-66b49f92-0ebc-469a-b6ac-62a292c117bc tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:51.330187 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-66b49f92-0ebc-469a-b6ac-62a292c117bc tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:51.330678 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-66b49f92-0ebc-469a-b6ac-62a292c117bc tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:51.331704 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-66b49f92-0ebc-469a-b6ac-62a292c117bc tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:51.332145 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-66b49f92-0ebc-469a-b6ac-62a292c117bc tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:51.362636 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-66b49f92-0ebc-469a-b6ac-62a292c117bc tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045283 Jul 01 16:51:51.363201 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 515/1023] 10.222.0.57 () {58 vars in 1301 bytes} [Fri Jul 1 16:51:51 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 16:51:51.430353 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0d19c202-bbe1-49c3-948a-1907d1106df2 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:51.430968 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0d19c202-bbe1-49c3-948a-1907d1106df2 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:51.438801 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0d19c202-bbe1-49c3-948a-1907d1106df2 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:51.439367 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0d19c202-bbe1-49c3-948a-1907d1106df2 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:51.440241 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0d19c202-bbe1-49c3-948a-1907d1106df2 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:51.440756 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0d19c202-bbe1-49c3-948a-1907d1106df2 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:51.468358 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0d19c202-bbe1-49c3-948a-1907d1106df2 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 16:51:51.548384 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0d19c202-bbe1-49c3-948a-1907d1106df2 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a" status: 204 len: 0 microversion: 2.1 time: 0.121563 Jul 01 16:51:51.549014 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 509/1024] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:51:51 2022] DELETE /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 16:51:51.558026 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-dd48945e-5755-405f-a729-c00a912e3143 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:51.558679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-dd48945e-5755-405f-a729-c00a912e3143 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:51.567820 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dd48945e-5755-405f-a729-c00a912e3143 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:51.568362 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dd48945e-5755-405f-a729-c00a912e3143 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:51.569232 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dd48945e-5755-405f-a729-c00a912e3143 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:51.569865 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dd48945e-5755-405f-a729-c00a912e3143 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:51.784010 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-dd48945e-5755-405f-a729-c00a912e3143 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:51:51.787640 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:51:51.795183 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-dd48945e-5755-405f-a729-c00a912e3143 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a" status: 200 len: 1673 microversion: 2.1 time: 0.241273 Jul 01 16:51:51.795798 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 516/1025] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:51:51 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a => generated 1673 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 16:51:52.813746 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c896cd9b-9be6-45ad-b48c-cc41867db07c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:52.814480 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c896cd9b-9be6-45ad-b48c-cc41867db07c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:52.821882 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c896cd9b-9be6-45ad-b48c-cc41867db07c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:52.822370 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c896cd9b-9be6-45ad-b48c-cc41867db07c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:52.823146 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c896cd9b-9be6-45ad-b48c-cc41867db07c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:52.823590 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c896cd9b-9be6-45ad-b48c-cc41867db07c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:52.961476 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c896cd9b-9be6-45ad-b48c-cc41867db07c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:51:52.969148 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c896cd9b-9be6-45ad-b48c-cc41867db07c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a" status: 200 len: 1673 microversion: 2.1 time: 0.159750 Jul 01 16:51:52.969731 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 510/1026] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:51:52 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:51:53.989203 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-855031d2-f8ea-4333-b9b8-6fc7cc58ed27 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:53.990488 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-855031d2-f8ea-4333-b9b8-6fc7cc58ed27 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:53.999118 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-855031d2-f8ea-4333-b9b8-6fc7cc58ed27 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:53.999938 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-855031d2-f8ea-4333-b9b8-6fc7cc58ed27 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:54.000952 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-855031d2-f8ea-4333-b9b8-6fc7cc58ed27 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:54.001607 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-855031d2-f8ea-4333-b9b8-6fc7cc58ed27 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:54.230241 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-855031d2-f8ea-4333-b9b8-6fc7cc58ed27 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:51:54.243033 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-855031d2-f8ea-4333-b9b8-6fc7cc58ed27 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a" status: 200 len: 1673 microversion: 2.1 time: 0.260092 Jul 01 16:51:54.245239 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 517/1027] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:51:53 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a => generated 1673 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:51:54.829772 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-8e9edff1-1ca3-4309-8091-85d3fc3d543b req-beca4729-0c6c-4228-bd28-20e7def23f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d621fc2-bc77-4d1d-b083-269b49a2133a", "name": "network-vif-deleted", "tag": "9c4e80c0-564e-49e0-b7cf-d9a47b529be5"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:51:54.862381 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-8e9edff1-1ca3-4309-8091-85d3fc3d543b req-beca4729-0c6c-4228-bd28-20e7def23f01 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:54.868128 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-8e9edff1-1ca3-4309-8091-85d3fc3d543b req-beca4729-0c6c-4228-bd28-20e7def23f01 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:54.896656 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-8e9edff1-1ca3-4309-8091-85d3fc3d543b req-beca4729-0c6c-4228-bd28-20e7def23f01 service nova] Creating event network-vif-deleted:9c4e80c0-564e-49e0-b7cf-d9a47b529be5 for instance 6d621fc2-bc77-4d1d-b083-269b49a2133a on hv-cinder-79760 Jul 01 16:51:54.903051 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-8e9edff1-1ca3-4309-8091-85d3fc3d543b req-beca4729-0c6c-4228-bd28-20e7def23f01 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078108 Jul 01 16:51:54.908786 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 511/1028] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:51:55.265221 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5c63d665-3cfa-4514-8f4e-90dd5739d6e6 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:55.266679 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5c63d665-3cfa-4514-8f4e-90dd5739d6e6 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:55.280797 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5c63d665-3cfa-4514-8f4e-90dd5739d6e6 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:55.281685 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5c63d665-3cfa-4514-8f4e-90dd5739d6e6 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:55.283334 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5c63d665-3cfa-4514-8f4e-90dd5739d6e6 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:55.285819 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5c63d665-3cfa-4514-8f4e-90dd5739d6e6 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:55.330722 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5c63d665-3cfa-4514-8f4e-90dd5739d6e6 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:55.332369 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5c63d665-3cfa-4514-8f4e-90dd5739d6e6 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:55.333905 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-5c63d665-3cfa-4514-8f4e-90dd5739d6e6 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lazy-loading 'fault' on Instance uuid 6d621fc2-bc77-4d1d-b083-269b49a2133a {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:51:55.412092 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5c63d665-3cfa-4514-8f4e-90dd5739d6e6 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25bcb63e6194aa9884e589db9f7ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b152a7ad4d44f8a292995a1598d238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:51:55.422420 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5c63d665-3cfa-4514-8f4e-90dd5739d6e6 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a" status: 200 len: 1326 microversion: 2.1 time: 0.165547 Jul 01 16:51:55.423776 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 518/1029] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:51:55 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a => generated 1326 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:51:56.440666 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1ce2fbd7-d33e-4835-8b8c-c8931a369732 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:56.441368 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1ce2fbd7-d33e-4835-8b8c-c8931a369732 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:56.448810 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1ce2fbd7-d33e-4835-8b8c-c8931a369732 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:56.449256 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1ce2fbd7-d33e-4835-8b8c-c8931a369732 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:56.450041 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1ce2fbd7-d33e-4835-8b8c-c8931a369732 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:56.450515 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1ce2fbd7-d33e-4835-8b8c-c8931a369732 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:56.466301 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-1ce2fbd7-d33e-4835-8b8c-c8931a369732 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] HTTP exception thrown: Instance 6d621fc2-bc77-4d1d-b083-269b49a2133a could not be found. Jul 01 16:51:56.468067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1ce2fbd7-d33e-4835-8b8c-c8931a369732 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Request method failure captured: Jul 01 16:51:56.468067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a HTTP/1.1 Jul 01 16:51:56.468067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:51:56.468067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:51:56.468067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:51:56.468067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:51:56.468067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:51:56.468067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:51:56.468067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:51:56.468067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:51:56.468067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyU16ejK507feFCzhWk8yY7CCzlL_Fv1ZIz6WjVcLYPsiPnhCyAnXJk4Pbz9iq6UEmup4njL0gr48QoyGdTJcBPjggU9MPvdIJLECXy3tKai7cwyoc_-hTOazqQgKK7iz5WYkj_T6SGCs2mRghajePcUx-Ey59912UzjbFQbBDTgHjo Jul 01 16:51:56.468067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:51:56.468067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:51:56.468067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:51:56.468067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:51:56.468067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:51:56.468067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:51:56.468067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: b1b152a7ad4d44f8a292995a1598d238 Jul 01 16:51:56.468067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeTestJSON-1720658346 Jul 01 16:51:56.468067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:51:56.468067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:51:56.469596 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:51:56.469596 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeTestJSON-1720658346 Jul 01 16:51:56.469596 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: b1b152a7ad4d44f8a292995a1598d238 Jul 01 16:51:56.469596 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1720658346 Jul 01 16:51:56.469596 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeTestJSON-1720658346-project Jul 01 16:51:56.469596 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:51:56.469596 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:51:56.469596 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: f25bcb63e6194aa9884e589db9f7ede6 Jul 01 16:51:56.469596 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeTestJSON-1720658346-project Jul 01 16:51:56.469596 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: > Jul 01 16:51:56.469596 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Instance 6d621fc2-bc77-4d1d-b083-269b49a2133a could not be found. Jul 01 16:51:56.469596 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'id': '6d621fc2-bc77-4d1d-b083-269b49a2133a'} Jul 01 16:51:56.470470 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:51:56.470470 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:51:56.470470 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:51:56.470470 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:51:56.470470 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:51:56.470470 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:51:56.470470 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:51:56.470470 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:51:56.470470 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:51:56.470470 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:51:56.470470 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d621fc2-bc77-4d1d-b083-269b49a2133a could not be found. Jul 01 16:51:56.470470 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:51:56.470470 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:51:56.470470 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:51:56.470470 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:51:56.470470 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:51:56.470470 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:51:56.470470 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:51:56.470470 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:51:56.470470 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:51:56.472034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:51:56.472034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:51:56.472034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:51:56.472034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:51:56.472034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:51:56.472034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:51:56.472034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:51:56.472034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d621fc2-bc77-4d1d-b083-269b49a2133a could not be found. Jul 01 16:51:56.472034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:51:56.472034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:51:56.472034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:51:56.472034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:51:56.472034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:51:56.472034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:51:56.472034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:51:56.472034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:51:56.472034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d621fc2-bc77-4d1d-b083-269b49a2133a could not be found. Jul 01 16:51:56.472034 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:51:56.473260 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1ce2fbd7-d33e-4835-8b8c-c8931a369732 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Returning 404 to user: Instance 6d621fc2-bc77-4d1d-b083-269b49a2133a could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:51:56.473260 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1ce2fbd7-d33e-4835-8b8c-c8931a369732 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a" status: 404 len: 111 microversion: 2.1 time: 0.033580 Jul 01 16:51:56.473260 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 512/1030] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:51:56 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:51:56.479788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-07bae091-2be0-4815-aca4-bc9fa226498c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '.version_select at 0x7fa86c394dc0>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:56.498847 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-07bae091-2be0-4815-aca4-bc9fa226498c tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-259786133" status: 202 len: 0 microversion: 2.1 time: 0.024028 Jul 01 16:51:56.499500 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 519/1031] 10.222.0.57 () {58 vars in 1217 bytes} [Fri Jul 1 16:51:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-259786133 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 16:51:59.466648 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a348459e-8eef-4caa-a386-7b7caa4293fa tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:59.467183 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a348459e-8eef-4caa-a386-7b7caa4293fa tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:59.473223 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a348459e-8eef-4caa-a386-7b7caa4293fa tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:59.473677 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a348459e-8eef-4caa-a386-7b7caa4293fa tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:59.474508 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a348459e-8eef-4caa-a386-7b7caa4293fa tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:59.474949 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a348459e-8eef-4caa-a386-7b7caa4293fa tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:59.488224 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-a348459e-8eef-4caa-a386-7b7caa4293fa tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] HTTP exception thrown: Instance 6d621fc2-bc77-4d1d-b083-269b49a2133a could not be found. Jul 01 16:51:59.489751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a348459e-8eef-4caa-a386-7b7caa4293fa tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Request method failure captured: Jul 01 16:51:59.489751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: DELETE /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a HTTP/1.1 Jul 01 16:51:59.489751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:51:59.489751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:51:59.489751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:51:59.489751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:51:59.489751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:51:59.489751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:51:59.489751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:51:59.489751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:51:59.489751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyU16ejK507feFCzhWk8yY7CCzlL_Fv1ZIz6WjVcLYPsiPnhCyAnXJk4Pbz9iq6UEmup4njL0gr48QoyGdTJcBPjggU9MPvdIJLECXy3tKai7cwyoc_-hTOazqQgKK7iz5WYkj_T6SGCs2mRghajePcUx-Ey59912UzjbFQbBDTgHjo Jul 01 16:51:59.489751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:51:59.489751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:51:59.489751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:51:59.489751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:51:59.489751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:51:59.489751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:51:59.489751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: b1b152a7ad4d44f8a292995a1598d238 Jul 01 16:51:59.489751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeTestJSON-1720658346 Jul 01 16:51:59.489751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:51:59.489751 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:51:59.492084 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:51:59.492084 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeTestJSON-1720658346 Jul 01 16:51:59.492084 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: b1b152a7ad4d44f8a292995a1598d238 Jul 01 16:51:59.492084 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1720658346 Jul 01 16:51:59.492084 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeTestJSON-1720658346-project Jul 01 16:51:59.492084 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:51:59.492084 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:51:59.492084 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: f25bcb63e6194aa9884e589db9f7ede6 Jul 01 16:51:59.492084 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeTestJSON-1720658346-project Jul 01 16:51:59.492084 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: > Jul 01 16:51:59.492084 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Instance 6d621fc2-bc77-4d1d-b083-269b49a2133a could not be found. Jul 01 16:51:59.492084 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'id': '6d621fc2-bc77-4d1d-b083-269b49a2133a'} Jul 01 16:51:59.493255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:51:59.493255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:51:59.493255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:51:59.493255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:51:59.493255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:51:59.493255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:51:59.493255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:51:59.493255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:51:59.493255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:51:59.493255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:51:59.493255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d621fc2-bc77-4d1d-b083-269b49a2133a could not be found. Jul 01 16:51:59.493255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:51:59.493255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:51:59.493255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:51:59.493255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:51:59.493255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:51:59.493255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:51:59.493255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:51:59.493255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:51:59.493255 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:51:59.494797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:51:59.494797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 16:51:59.494797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 16:51:59.494797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 16:51:59.494797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 16:51:59.494797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:51:59.494797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:51:59.494797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:51:59.494797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:51:59.494797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d621fc2-bc77-4d1d-b083-269b49a2133a could not be found. Jul 01 16:51:59.494797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:51:59.494797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:51:59.494797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:51:59.494797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:51:59.494797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:51:59.494797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:51:59.494797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:51:59.494797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:51:59.494797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d621fc2-bc77-4d1d-b083-269b49a2133a could not be found. Jul 01 16:51:59.494797 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:51:59.496339 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a348459e-8eef-4caa-a386-7b7caa4293fa tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Returning 404 to user: Instance 6d621fc2-bc77-4d1d-b083-269b49a2133a could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:51:59.496339 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a348459e-8eef-4caa-a386-7b7caa4293fa tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a" status: 404 len: 111 microversion: 2.1 time: 0.028976 Jul 01 16:51:59.496339 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 513/1032] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:51:59 2022] DELETE /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 16:51:59.500836 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c2d77e6a-e70c-4020-a6f5-5f8549c98300 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:51:59.501437 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c2d77e6a-e70c-4020-a6f5-5f8549c98300 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: 6d621fc2-bc77-4d1d-b083-269b49a2133a] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:51:59.508787 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c2d77e6a-e70c-4020-a6f5-5f8549c98300 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:59.509229 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c2d77e6a-e70c-4020-a6f5-5f8549c98300 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:59.509980 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c2d77e6a-e70c-4020-a6f5-5f8549c98300 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:51:59.510442 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c2d77e6a-e70c-4020-a6f5-5f8549c98300 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:51:59.523847 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-c2d77e6a-e70c-4020-a6f5-5f8549c98300 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] HTTP exception thrown: Instance 6d621fc2-bc77-4d1d-b083-269b49a2133a could not be found. Jul 01 16:51:59.525454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c2d77e6a-e70c-4020-a6f5-5f8549c98300 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Request method failure captured: Jul 01 16:51:59.525454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a HTTP/1.1 Jul 01 16:51:59.525454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:51:59.525454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:51:59.525454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:51:59.525454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:51:59.525454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:51:59.525454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:51:59.525454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:51:59.525454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:51:59.525454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyU16ejK507feFCzhWk8yY7CCzlL_Fv1ZIz6WjVcLYPsiPnhCyAnXJk4Pbz9iq6UEmup4njL0gr48QoyGdTJcBPjggU9MPvdIJLECXy3tKai7cwyoc_-hTOazqQgKK7iz5WYkj_T6SGCs2mRghajePcUx-Ey59912UzjbFQbBDTgHjo Jul 01 16:51:59.525454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:51:59.525454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:51:59.525454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:51:59.525454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:51:59.525454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:51:59.525454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:51:59.525454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: b1b152a7ad4d44f8a292995a1598d238 Jul 01 16:51:59.525454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeTestJSON-1720658346 Jul 01 16:51:59.525454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:51:59.525454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:51:59.527225 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:51:59.527225 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeTestJSON-1720658346 Jul 01 16:51:59.527225 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: b1b152a7ad4d44f8a292995a1598d238 Jul 01 16:51:59.527225 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1720658346 Jul 01 16:51:59.527225 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeTestJSON-1720658346-project Jul 01 16:51:59.527225 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:51:59.527225 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:51:59.527225 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: f25bcb63e6194aa9884e589db9f7ede6 Jul 01 16:51:59.527225 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeTestJSON-1720658346-project Jul 01 16:51:59.527225 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:51:59.527225 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance 6d621fc2-bc77-4d1d-b083-269b49a2133a could not be found. Jul 01 16:51:59.527225 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': '6d621fc2-bc77-4d1d-b083-269b49a2133a'} Jul 01 16:51:59.528322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:51:59.528322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:51:59.528322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:51:59.528322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:51:59.528322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:51:59.528322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:51:59.528322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:51:59.528322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:51:59.528322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:51:59.528322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:51:59.528322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d621fc2-bc77-4d1d-b083-269b49a2133a could not be found. Jul 01 16:51:59.528322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:59.528322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:51:59.528322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:59.528322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:51:59.528322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:51:59.528322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:51:59.528322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:51:59.528322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:51:59.528322 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:51:59.529824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:51:59.529824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:51:59.529824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:51:59.529824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:51:59.529824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:51:59.529824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:51:59.529824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:51:59.529824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d621fc2-bc77-4d1d-b083-269b49a2133a could not be found. Jul 01 16:51:59.529824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:59.529824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:51:59.529824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:59.529824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:51:59.529824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:51:59.529824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:51:59.529824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:51:59.529824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:51:59.529824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d621fc2-bc77-4d1d-b083-269b49a2133a could not be found. Jul 01 16:51:59.529824 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:51:59.531273 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c2d77e6a-e70c-4020-a6f5-5f8549c98300 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Returning 404 to user: Instance 6d621fc2-bc77-4d1d-b083-269b49a2133a could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:51:59.531273 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c2d77e6a-e70c-4020-a6f5-5f8549c98300 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a" status: 404 len: 111 microversion: 2.1 time: 0.030335 Jul 01 16:51:59.531273 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 520/1033] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:51:59 2022] GET /compute/v2.1/servers/6d621fc2-bc77-4d1d-b083-269b49a2133a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:52:00.664921 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-59488600-1a40-42d8-ab14-3a1545418776 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:52:00.665453 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-59488600-1a40-42d8-ab14-3a1545418776 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:52:00.671953 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-59488600-1a40-42d8-ab14-3a1545418776 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:52:00.672406 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-59488600-1a40-42d8-ab14-3a1545418776 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:52:00.673183 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-59488600-1a40-42d8-ab14-3a1545418776 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:52:00.673626 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-59488600-1a40-42d8-ab14-3a1545418776 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:52:00.687128 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-59488600-1a40-42d8-ab14-3a1545418776 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] HTTP exception thrown: Instance f6c54f9e-6923-4f5c-a7de-be304f3587dc could not be found. Jul 01 16:52:00.688664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-59488600-1a40-42d8-ab14-3a1545418776 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Request method failure captured: Jul 01 16:52:00.688664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: DELETE /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc HTTP/1.1 Jul 01 16:52:00.688664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:52:00.688664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:52:00.688664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:52:00.688664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:52:00.688664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:52:00.688664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:52:00.688664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:52:00.688664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:52:00.688664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyU16ejK507feFCzhWk8yY7CCzlL_Fv1ZIz6WjVcLYPsiPnhCyAnXJk4Pbz9iq6UEmup4njL0gr48QoyGdTJcBPjggU9MPvdIJLECXy3tKai7cwyoc_-hTOazqQgKK7iz5WYkj_T6SGCs2mRghajePcUx-Ey59912UzjbFQbBDTgHjo Jul 01 16:52:00.688664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:52:00.688664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:52:00.688664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:52:00.688664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:52:00.688664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:52:00.688664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:52:00.688664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: b1b152a7ad4d44f8a292995a1598d238 Jul 01 16:52:00.688664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeTestJSON-1720658346 Jul 01 16:52:00.688664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:52:00.688664 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:52:00.690269 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:52:00.690269 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeTestJSON-1720658346 Jul 01 16:52:00.690269 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: b1b152a7ad4d44f8a292995a1598d238 Jul 01 16:52:00.690269 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1720658346 Jul 01 16:52:00.690269 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeTestJSON-1720658346-project Jul 01 16:52:00.690269 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:52:00.690269 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:52:00.690269 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: f25bcb63e6194aa9884e589db9f7ede6 Jul 01 16:52:00.690269 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeTestJSON-1720658346-project Jul 01 16:52:00.690269 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: > Jul 01 16:52:00.690269 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Instance f6c54f9e-6923-4f5c-a7de-be304f3587dc could not be found. Jul 01 16:52:00.690269 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'id': 'f6c54f9e-6923-4f5c-a7de-be304f3587dc'} Jul 01 16:52:00.694811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:52:00.694811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:52:00.694811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:52:00.694811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:52:00.694811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:52:00.694811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:52:00.694811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:52:00.694811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:52:00.694811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:52:00.694811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:52:00.694811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6c54f9e-6923-4f5c-a7de-be304f3587dc could not be found. Jul 01 16:52:00.694811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:52:00.694811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:52:00.694811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:52:00.694811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:52:00.694811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:52:00.694811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:52:00.694811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:52:00.694811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:52:00.694811 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:52:00.697519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:52:00.697519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 16:52:00.697519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 16:52:00.697519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 16:52:00.697519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 16:52:00.697519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:52:00.697519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:52:00.697519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:52:00.697519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:52:00.697519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6c54f9e-6923-4f5c-a7de-be304f3587dc could not be found. Jul 01 16:52:00.697519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:52:00.697519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:52:00.697519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:52:00.697519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:52:00.697519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:52:00.697519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:52:00.697519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:52:00.697519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:52:00.697519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6c54f9e-6923-4f5c-a7de-be304f3587dc could not be found. Jul 01 16:52:00.697519 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:52:00.699511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-59488600-1a40-42d8-ab14-3a1545418776 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Returning 404 to user: Instance f6c54f9e-6923-4f5c-a7de-be304f3587dc could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:52:00.699511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-59488600-1a40-42d8-ab14-3a1545418776 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 404 len: 111 microversion: 2.1 time: 0.029329 Jul 01 16:52:00.699511 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 514/1034] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:52:00 2022] DELETE /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:52:00.699796 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-011a93ef-9e40-45db-8dc1-66f9d9a9cd29 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:52:00.700319 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-011a93ef-9e40-45db-8dc1-66f9d9a9cd29 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] [instance: f6c54f9e-6923-4f5c-a7de-be304f3587dc] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:52:00.706970 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-011a93ef-9e40-45db-8dc1-66f9d9a9cd29 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:52:00.707413 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-011a93ef-9e40-45db-8dc1-66f9d9a9cd29 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:52:00.708167 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-011a93ef-9e40-45db-8dc1-66f9d9a9cd29 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:52:00.708597 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-011a93ef-9e40-45db-8dc1-66f9d9a9cd29 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:52:00.724395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-011a93ef-9e40-45db-8dc1-66f9d9a9cd29 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] HTTP exception thrown: Instance f6c54f9e-6923-4f5c-a7de-be304f3587dc could not be found. Jul 01 16:52:00.725953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-011a93ef-9e40-45db-8dc1-66f9d9a9cd29 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Request method failure captured: Jul 01 16:52:00.725953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc HTTP/1.1 Jul 01 16:52:00.725953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:52:00.725953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:52:00.725953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:52:00.725953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:52:00.725953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:52:00.725953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:52:00.725953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:52:00.725953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:52:00.725953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyU16ejK507feFCzhWk8yY7CCzlL_Fv1ZIz6WjVcLYPsiPnhCyAnXJk4Pbz9iq6UEmup4njL0gr48QoyGdTJcBPjggU9MPvdIJLECXy3tKai7cwyoc_-hTOazqQgKK7iz5WYkj_T6SGCs2mRghajePcUx-Ey59912UzjbFQbBDTgHjo Jul 01 16:52:00.725953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:52:00.725953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:52:00.725953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:52:00.725953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:52:00.725953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:52:00.725953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:52:00.725953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: b1b152a7ad4d44f8a292995a1598d238 Jul 01 16:52:00.725953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeTestJSON-1720658346 Jul 01 16:52:00.725953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:52:00.725953 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:52:00.727619 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b1b152a7ad4d44f8a292995a1598d238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:52:00.727619 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeTestJSON-1720658346 Jul 01 16:52:00.727619 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: b1b152a7ad4d44f8a292995a1598d238 Jul 01 16:52:00.727619 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1720658346 Jul 01 16:52:00.727619 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeTestJSON-1720658346-project Jul 01 16:52:00.727619 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:52:00.727619 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:52:00.727619 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: f25bcb63e6194aa9884e589db9f7ede6 Jul 01 16:52:00.727619 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeTestJSON-1720658346-project Jul 01 16:52:00.727619 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:52:00.727619 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance f6c54f9e-6923-4f5c-a7de-be304f3587dc could not be found. Jul 01 16:52:00.727619 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': 'f6c54f9e-6923-4f5c-a7de-be304f3587dc'} Jul 01 16:52:00.728460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:52:00.728460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:52:00.728460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:52:00.728460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:52:00.728460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:52:00.728460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:52:00.728460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:52:00.728460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:52:00.728460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:52:00.728460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:52:00.728460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6c54f9e-6923-4f5c-a7de-be304f3587dc could not be found. Jul 01 16:52:00.728460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:52:00.728460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:52:00.728460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:52:00.728460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:52:00.728460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:52:00.728460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:52:00.728460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:52:00.728460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:52:00.728460 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:52:00.729680 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:52:00.729680 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:52:00.729680 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:52:00.729680 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:52:00.729680 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:52:00.729680 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:52:00.729680 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:52:00.729680 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6c54f9e-6923-4f5c-a7de-be304f3587dc could not be found. Jul 01 16:52:00.729680 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:52:00.729680 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:52:00.729680 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:52:00.729680 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:52:00.729680 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:52:00.729680 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:52:00.729680 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:52:00.729680 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:52:00.729680 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6c54f9e-6923-4f5c-a7de-be304f3587dc could not be found. Jul 01 16:52:00.729680 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:52:00.730910 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-011a93ef-9e40-45db-8dc1-66f9d9a9cd29 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] Returning 404 to user: Instance f6c54f9e-6923-4f5c-a7de-be304f3587dc could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:52:00.730910 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-011a93ef-9e40-45db-8dc1-66f9d9a9cd29 tempest-AttachVolumeTestJSON-1720658346 tempest-AttachVolumeTestJSON-1720658346-project] 10.222.0.57 "GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc" status: 404 len: 111 microversion: 2.1 time: 0.032031 Jul 01 16:52:00.730910 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 521/1035] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:52:00 2022] GET /compute/v2.1/servers/f6c54f9e-6923-4f5c-a7de-be304f3587dc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:53:11.538758 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:53:11.539568 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:53:11.543556 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-60eb4213-f0a9-4fab-91dd-0e9ea1bd0bf5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1866116092", "imageRef": "42a4b1a9-dea6-4c87-a2c1-328b9c0c8558", "flavorRef": "452", "networks": [{"uuid": "08000a35-2dec-4993-b9a5-7cf20485ea74"}]}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:53:11.609652 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-60eb4213-f0a9-4fab-91dd-0e9ea1bd0bf5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] validate_networks() for [('08000a35-2dec-4993-b9a5-7cf20485ea74', None, None, None, None, None)] {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 16:53:12.055217 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-60eb4213-f0a9-4fab-91dd-0e9ea1bd0bf5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 16:53:12.055643 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-60eb4213-f0a9-4fab-91dd-0e9ea1bd0bf5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 16:53:12.056152 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-60eb4213-f0a9-4fab-91dd-0e9ea1bd0bf5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 16:53:12.056562 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-60eb4213-f0a9-4fab-91dd-0e9ea1bd0bf5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 16:53:12.056975 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-60eb4213-f0a9-4fab-91dd-0e9ea1bd0bf5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 16:53:12.065849 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-60eb4213-f0a9-4fab-91dd-0e9ea1bd0bf5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:12.066298 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-60eb4213-f0a9-4fab-91dd-0e9ea1bd0bf5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:12.067128 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-60eb4213-f0a9-4fab-91dd-0e9ea1bd0bf5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:12.067606 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-60eb4213-f0a9-4fab-91dd-0e9ea1bd0bf5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:12.085505 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-60eb4213-f0a9-4fab-91dd-0e9ea1bd0bf5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Getting quotas for project 0879ab147a0b4fbeb3ec90fdfdb53f24. Resources: {'ram', 'cores', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:53:12.089467 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-60eb4213-f0a9-4fab-91dd-0e9ea1bd0bf5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Getting quotas for user 520e0eae82a64ed98a6c0cfbd19cdbb4 and project 0879ab147a0b4fbeb3ec90fdfdb53f24. Resources: {'ram', 'cores', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:53:12.100641 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-60eb4213-f0a9-4fab-91dd-0e9ea1bd0bf5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 16:53:12.102928 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-60eb4213-f0a9-4fab-91dd-0e9ea1bd0bf5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: e3e5fc84-bcc4-4f95-9ef2-749766d42994] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42a4b1a9-dea6-4c87-a2c1-328b9c0c8558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 16:53:12.152852 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-60eb4213-f0a9-4fab-91dd-0e9ea1bd0bf5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616849 Jul 01 16:53:12.153523 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 515/1036] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 1 16:53:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 16:53:12.161316 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:53:12.162171 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=18 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:53:12.166596 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d7f214d5-b1ad-4825-81da-6184d7552e29 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:53:12.167310 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d7f214d5-b1ad-4825-81da-6184d7552e29 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: e3e5fc84-bcc4-4f95-9ef2-749766d42994] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:53:12.230232 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d7f214d5-b1ad-4825-81da-6184d7552e29 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:53:12.237078 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d7f214d5-b1ad-4825-81da-6184d7552e29 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994" status: 200 len: 1219 microversion: 2.1 time: 0.077601 Jul 01 16:53:12.237632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 522/1037] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:53:12 2022] GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:53:13.256013 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4afa8e45-1686-4752-97f2-c9ec68733b32 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:53:13.257337 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4afa8e45-1686-4752-97f2-c9ec68733b32 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: e3e5fc84-bcc4-4f95-9ef2-749766d42994] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:53:13.266782 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4afa8e45-1686-4752-97f2-c9ec68733b32 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:13.267240 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4afa8e45-1686-4752-97f2-c9ec68733b32 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:13.268022 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4afa8e45-1686-4752-97f2-c9ec68733b32 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:13.268460 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4afa8e45-1686-4752-97f2-c9ec68733b32 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:13.331877 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4afa8e45-1686-4752-97f2-c9ec68733b32 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:53:13.339939 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4afa8e45-1686-4752-97f2-c9ec68733b32 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994" status: 200 len: 1279 microversion: 2.1 time: 0.088465 Jul 01 16:53:13.340507 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 516/1038] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:53:13 2022] GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994 => generated 1279 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:53:14.357107 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-31b0d7d6-99d4-432e-af4d-7c0f29c1449d tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:53:14.357659 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-31b0d7d6-99d4-432e-af4d-7c0f29c1449d tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: e3e5fc84-bcc4-4f95-9ef2-749766d42994] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:53:14.364138 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-31b0d7d6-99d4-432e-af4d-7c0f29c1449d tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:14.364591 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-31b0d7d6-99d4-432e-af4d-7c0f29c1449d tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:14.365358 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-31b0d7d6-99d4-432e-af4d-7c0f29c1449d tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:14.365993 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-31b0d7d6-99d4-432e-af4d-7c0f29c1449d tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:14.605492 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-31b0d7d6-99d4-432e-af4d-7c0f29c1449d tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:53:14.613183 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-31b0d7d6-99d4-432e-af4d-7c0f29c1449d tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994" status: 200 len: 1319 microversion: 2.1 time: 0.259951 Jul 01 16:53:14.613678 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 523/1039] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:53:14 2022] GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:53:14.816663 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-1716563a-e30b-4f3c-854e-868600d3ff72 req-63a01dc5-0e76-40df-9c1b-9e107616d1dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3e5fc84-bcc4-4f95-9ef2-749766d42994", "tag": "9a2af661-e982-4046-938b-7b6145a3eee3"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:53:14.827269 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-1716563a-e30b-4f3c-854e-868600d3ff72 req-63a01dc5-0e76-40df-9c1b-9e107616d1dc service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:14.827712 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-1716563a-e30b-4f3c-854e-868600d3ff72 req-63a01dc5-0e76-40df-9c1b-9e107616d1dc service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:14.841701 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-1716563a-e30b-4f3c-854e-868600d3ff72 req-63a01dc5-0e76-40df-9c1b-9e107616d1dc service nova] Creating event network-changed:9a2af661-e982-4046-938b-7b6145a3eee3 for instance e3e5fc84-bcc4-4f95-9ef2-749766d42994 on hv-cinder-79760 Jul 01 16:53:14.846654 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-1716563a-e30b-4f3c-854e-868600d3ff72 req-63a01dc5-0e76-40df-9c1b-9e107616d1dc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037354 Jul 01 16:53:14.847570 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 517/1040] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:53:15.630489 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8b4a0cdb-2f5f-4728-8cc3-de4606eacd0f tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:53:15.631687 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8b4a0cdb-2f5f-4728-8cc3-de4606eacd0f tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: e3e5fc84-bcc4-4f95-9ef2-749766d42994] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:53:15.638468 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8b4a0cdb-2f5f-4728-8cc3-de4606eacd0f tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:15.638906 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8b4a0cdb-2f5f-4728-8cc3-de4606eacd0f tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:15.639658 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8b4a0cdb-2f5f-4728-8cc3-de4606eacd0f tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:15.640081 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8b4a0cdb-2f5f-4728-8cc3-de4606eacd0f tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:16.045990 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8b4a0cdb-2f5f-4728-8cc3-de4606eacd0f tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:53:16.054518 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8b4a0cdb-2f5f-4728-8cc3-de4606eacd0f tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994" status: 200 len: 1319 microversion: 2.1 time: 0.426735 Jul 01 16:53:16.055094 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 524/1041] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:53:15 2022] GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994 => generated 1319 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:53:17.072046 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a63f5612-5043-47c7-8fde-58e2ba7e46b4 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:53:17.072823 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a63f5612-5043-47c7-8fde-58e2ba7e46b4 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: e3e5fc84-bcc4-4f95-9ef2-749766d42994] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:53:17.079121 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a63f5612-5043-47c7-8fde-58e2ba7e46b4 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:17.079568 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a63f5612-5043-47c7-8fde-58e2ba7e46b4 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:17.080343 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a63f5612-5043-47c7-8fde-58e2ba7e46b4 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:17.080785 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a63f5612-5043-47c7-8fde-58e2ba7e46b4 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:17.214313 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a63f5612-5043-47c7-8fde-58e2ba7e46b4 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:53:17.221639 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a63f5612-5043-47c7-8fde-58e2ba7e46b4 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994" status: 200 len: 1319 microversion: 2.1 time: 0.154270 Jul 01 16:53:17.222203 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 518/1042] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:53:17 2022] GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:53:18.238454 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-59d8f035-37cc-4470-883e-5ede52555a45 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:53:18.239096 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-59d8f035-37cc-4470-883e-5ede52555a45 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: e3e5fc84-bcc4-4f95-9ef2-749766d42994] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:53:18.246948 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-59d8f035-37cc-4470-883e-5ede52555a45 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:18.247395 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-59d8f035-37cc-4470-883e-5ede52555a45 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:18.248161 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-59d8f035-37cc-4470-883e-5ede52555a45 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:18.248593 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-59d8f035-37cc-4470-883e-5ede52555a45 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:18.393290 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-59d8f035-37cc-4470-883e-5ede52555a45 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:53:18.400888 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-59d8f035-37cc-4470-883e-5ede52555a45 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994" status: 200 len: 1319 microversion: 2.1 time: 0.166367 Jul 01 16:53:18.401473 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 525/1043] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:53:18 2022] GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:53:19.417584 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e94a3ee2-32c1-44d3-98bb-4783f54341a9 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:53:19.418201 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e94a3ee2-32c1-44d3-98bb-4783f54341a9 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: e3e5fc84-bcc4-4f95-9ef2-749766d42994] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:53:19.424484 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e94a3ee2-32c1-44d3-98bb-4783f54341a9 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:19.424937 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e94a3ee2-32c1-44d3-98bb-4783f54341a9 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:19.425708 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e94a3ee2-32c1-44d3-98bb-4783f54341a9 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:19.426151 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e94a3ee2-32c1-44d3-98bb-4783f54341a9 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:19.557493 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e94a3ee2-32c1-44d3-98bb-4783f54341a9 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:53:19.564814 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e94a3ee2-32c1-44d3-98bb-4783f54341a9 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994" status: 200 len: 1319 microversion: 2.1 time: 0.151833 Jul 01 16:53:19.565373 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 519/1044] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:53:19 2022] GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:53:20.103517 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-6110c4cf-d28e-4442-a4d9-aecca92123c6 req-fcd46593-0c38-4077-a547-8d69c160b329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3e5fc84-bcc4-4f95-9ef2-749766d42994", "name": "network-vif-plugged", "status": "completed", "tag": "9a2af661-e982-4046-938b-7b6145a3eee3"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:53:20.111474 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-6110c4cf-d28e-4442-a4d9-aecca92123c6 req-fcd46593-0c38-4077-a547-8d69c160b329 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:20.111909 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-6110c4cf-d28e-4442-a4d9-aecca92123c6 req-fcd46593-0c38-4077-a547-8d69c160b329 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:20.123145 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-6110c4cf-d28e-4442-a4d9-aecca92123c6 req-fcd46593-0c38-4077-a547-8d69c160b329 service nova] Creating event network-vif-plugged:9a2af661-e982-4046-938b-7b6145a3eee3 for instance e3e5fc84-bcc4-4f95-9ef2-749766d42994 on hv-cinder-79760 Jul 01 16:53:20.128165 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-6110c4cf-d28e-4442-a4d9-aecca92123c6 req-fcd46593-0c38-4077-a547-8d69c160b329 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163690 Jul 01 16:53:20.128732 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 526/1045] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:53:20.580942 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-243e427b-0799-459a-9751-026ba75bb76e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:53:20.581592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-243e427b-0799-459a-9751-026ba75bb76e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: e3e5fc84-bcc4-4f95-9ef2-749766d42994] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:53:20.588951 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-243e427b-0799-459a-9751-026ba75bb76e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:20.589406 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-243e427b-0799-459a-9751-026ba75bb76e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:20.590176 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-243e427b-0799-459a-9751-026ba75bb76e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:20.590646 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-243e427b-0799-459a-9751-026ba75bb76e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:20.731777 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-243e427b-0799-459a-9751-026ba75bb76e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:53:20.739254 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-243e427b-0799-459a-9751-026ba75bb76e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994" status: 200 len: 1319 microversion: 2.1 time: 0.162195 Jul 01 16:53:20.739821 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 520/1046] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:53:20 2022] GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:53:21.757349 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-09155565-7003-465d-9cf1-c7fe278174ff tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:53:21.757967 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-09155565-7003-465d-9cf1-c7fe278174ff tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: e3e5fc84-bcc4-4f95-9ef2-749766d42994] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:53:21.767032 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-09155565-7003-465d-9cf1-c7fe278174ff tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:21.767490 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-09155565-7003-465d-9cf1-c7fe278174ff tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:21.768279 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-09155565-7003-465d-9cf1-c7fe278174ff tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:21.768710 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-09155565-7003-465d-9cf1-c7fe278174ff tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:21.902223 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-09155565-7003-465d-9cf1-c7fe278174ff tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:53:21.909862 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-09155565-7003-465d-9cf1-c7fe278174ff tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994" status: 200 len: 1319 microversion: 2.1 time: 0.157189 Jul 01 16:53:21.910445 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 527/1047] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:53:21 2022] GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:53:22.926876 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-95fedc39-04be-4024-b3aa-cb6df693d66e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:53:22.927601 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-95fedc39-04be-4024-b3aa-cb6df693d66e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: e3e5fc84-bcc4-4f95-9ef2-749766d42994] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:53:22.929968 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:53:22.931222 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=6 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:53:22.936515 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-95fedc39-04be-4024-b3aa-cb6df693d66e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:22.936896 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-95fedc39-04be-4024-b3aa-cb6df693d66e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:22.937720 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-95fedc39-04be-4024-b3aa-cb6df693d66e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:22.938152 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-95fedc39-04be-4024-b3aa-cb6df693d66e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:23.081373 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-95fedc39-04be-4024-b3aa-cb6df693d66e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:53:23.089237 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-95fedc39-04be-4024-b3aa-cb6df693d66e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994" status: 200 len: 1508 microversion: 2.1 time: 0.166211 Jul 01 16:53:23.089796 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 521/1048] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:53:22 2022] GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:53:38.219495 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c5f1a277-7923-428a-9eec-203abe062465 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10f2ca34-b749-49a9-a225-dae5af40a4d1", "device": "/dev/sdb"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:53:38.221147 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c5f1a277-7923-428a-9eec-203abe062465 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: e3e5fc84-bcc4-4f95-9ef2-749766d42994] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:53:38.223346 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:53:38.224067 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=14 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:53:38.224746 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=26 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:53:38.231641 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c5f1a277-7923-428a-9eec-203abe062465 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:38.232093 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c5f1a277-7923-428a-9eec-203abe062465 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:38.232861 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c5f1a277-7923-428a-9eec-203abe062465 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:53:38.233298 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c5f1a277-7923-428a-9eec-203abe062465 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:53:38.498100 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c5f1a277-7923-428a-9eec-203abe062465 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "POST /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282246 Jul 01 16:53:38.498834 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 528/1049] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 1 16:53:38 2022] POST /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:53:42.941977 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 16:53:42.942444 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Fri Jul 1 16:53:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 16:53:54.211733 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 16:53:54.212983 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Fri Jul 1 16:53:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 16:54:02.148343 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e950e07c-0b7e-404d-b0c9-d932584cc335 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:54:02.148856 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e950e07c-0b7e-404d-b0c9-d932584cc335 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: e3e5fc84-bcc4-4f95-9ef2-749766d42994] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:54:02.151768 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:54:02.152513 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=34 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:54:02.159201 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e950e07c-0b7e-404d-b0c9-d932584cc335 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:02.159645 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e950e07c-0b7e-404d-b0c9-d932584cc335 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:02.160414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e950e07c-0b7e-404d-b0c9-d932584cc335 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:02.160844 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e950e07c-0b7e-404d-b0c9-d932584cc335 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:02.245651 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-e950e07c-0b7e-404d-b0c9-d932584cc335 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lazy-loading 'services' on Instance uuid e3e5fc84-bcc4-4f95-9ef2-749766d42994 {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:54:02.319543 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e950e07c-0b7e-404d-b0c9-d932584cc335 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994/os-volume_attachments/10f2ca34-b749-49a9-a225-dae5af40a4d1" status: 202 len: 0 microversion: 2.1 time: 0.174773 Jul 01 16:54:02.320137 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 522/1050] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 1 16:54:02 2022] DELETE /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994/os-volume_attachments/10f2ca34-b749-49a9-a225-dae5af40a4d1 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:54:03.431321 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:54:03.432119 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:54:03.436111 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-32313186-2c5f-46a0-9b4c-90be68bee5c3 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:54:03.436707 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-32313186-2c5f-46a0-9b4c-90be68bee5c3 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: e3e5fc84-bcc4-4f95-9ef2-749766d42994] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:54:03.447609 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-32313186-2c5f-46a0-9b4c-90be68bee5c3 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:03.448065 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-32313186-2c5f-46a0-9b4c-90be68bee5c3 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:03.448837 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-32313186-2c5f-46a0-9b4c-90be68bee5c3 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:03.449276 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-32313186-2c5f-46a0-9b4c-90be68bee5c3 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:03.474751 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-32313186-2c5f-46a0-9b4c-90be68bee5c3 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: e3e5fc84-bcc4-4f95-9ef2-749766d42994] Going to try to terminate instance {{(pid=124317) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 16:54:03.548988 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-32313186-2c5f-46a0-9b4c-90be68bee5c3 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994" status: 204 len: 0 microversion: 2.1 time: 0.119410 Jul 01 16:54:03.549586 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 529/1051] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:54:03 2022] DELETE /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 16:54:03.559610 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b442cc62-ad5a-407d-9d60-11325ad716e3 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:54:03.560425 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b442cc62-ad5a-407d-9d60-11325ad716e3 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: e3e5fc84-bcc4-4f95-9ef2-749766d42994] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:54:03.566804 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b442cc62-ad5a-407d-9d60-11325ad716e3 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:03.567258 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b442cc62-ad5a-407d-9d60-11325ad716e3 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:03.568029 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b442cc62-ad5a-407d-9d60-11325ad716e3 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:03.568470 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b442cc62-ad5a-407d-9d60-11325ad716e3 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:03.700558 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b442cc62-ad5a-407d-9d60-11325ad716e3 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:54:03.707908 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b442cc62-ad5a-407d-9d60-11325ad716e3 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994" status: 200 len: 1514 microversion: 2.1 time: 0.153741 Jul 01 16:54:03.708465 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 523/1052] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:54:03 2022] GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:54:04.725780 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9284062c-61f9-4ee7-998c-4e0e739c426a tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:54:04.726556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-9284062c-61f9-4ee7-998c-4e0e739c426a tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: e3e5fc84-bcc4-4f95-9ef2-749766d42994] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:54:04.733321 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9284062c-61f9-4ee7-998c-4e0e739c426a tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:04.733768 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9284062c-61f9-4ee7-998c-4e0e739c426a tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:04.734556 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9284062c-61f9-4ee7-998c-4e0e739c426a tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:04.734995 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9284062c-61f9-4ee7-998c-4e0e739c426a tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:04.867646 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9284062c-61f9-4ee7-998c-4e0e739c426a tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:54:04.876107 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9284062c-61f9-4ee7-998c-4e0e739c426a tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994" status: 200 len: 1514 microversion: 2.1 time: 0.154625 Jul 01 16:54:04.876673 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 530/1053] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:54:04 2022] GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:54:05.842586 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-496f5870-c6f5-4192-b414-2dda02200e74 req-4f4c5a31-e27e-43da-b308-66d85831478d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3e5fc84-bcc4-4f95-9ef2-749766d42994", "name": "network-vif-deleted", "tag": "9a2af661-e982-4046-938b-7b6145a3eee3"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:54:05.851414 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-496f5870-c6f5-4192-b414-2dda02200e74 req-4f4c5a31-e27e-43da-b308-66d85831478d service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:05.851880 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-496f5870-c6f5-4192-b414-2dda02200e74 req-4f4c5a31-e27e-43da-b308-66d85831478d service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:05.863374 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-496f5870-c6f5-4192-b414-2dda02200e74 req-4f4c5a31-e27e-43da-b308-66d85831478d service nova] Creating event network-vif-deleted:9a2af661-e982-4046-938b-7b6145a3eee3 for instance e3e5fc84-bcc4-4f95-9ef2-749766d42994 on hv-cinder-79760 Jul 01 16:54:05.868116 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-496f5870-c6f5-4192-b414-2dda02200e74 req-4f4c5a31-e27e-43da-b308-66d85831478d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029171 Jul 01 16:54:05.869262 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 524/1054] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:54:05.893665 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f190732e-5404-4446-9662-b23803200a24 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:54:05.894267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f190732e-5404-4446-9662-b23803200a24 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: e3e5fc84-bcc4-4f95-9ef2-749766d42994] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:54:05.901788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f190732e-5404-4446-9662-b23803200a24 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:05.902325 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f190732e-5404-4446-9662-b23803200a24 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:05.903238 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f190732e-5404-4446-9662-b23803200a24 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:05.903748 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f190732e-5404-4446-9662-b23803200a24 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:05.970228 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f190732e-5404-4446-9662-b23803200a24 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:54:05.978277 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f190732e-5404-4446-9662-b23803200a24 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994" status: 200 len: 1304 microversion: 2.1 time: 0.088236 Jul 01 16:54:05.978880 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 531/1055] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:54:05 2022] GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994 => generated 1304 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:54:06.996319 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5d9ed9e6-7164-4dc8-b4a1-251c30e390a5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:54:06.997454 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5d9ed9e6-7164-4dc8-b4a1-251c30e390a5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: e3e5fc84-bcc4-4f95-9ef2-749766d42994] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:54:07.003753 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5d9ed9e6-7164-4dc8-b4a1-251c30e390a5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:07.004200 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5d9ed9e6-7164-4dc8-b4a1-251c30e390a5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:07.004970 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5d9ed9e6-7164-4dc8-b4a1-251c30e390a5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:07.005411 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5d9ed9e6-7164-4dc8-b4a1-251c30e390a5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:07.018961 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-5d9ed9e6-7164-4dc8-b4a1-251c30e390a5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] HTTP exception thrown: Instance e3e5fc84-bcc4-4f95-9ef2-749766d42994 could not be found. Jul 01 16:54:07.020592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5d9ed9e6-7164-4dc8-b4a1-251c30e390a5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Request method failure captured: Jul 01 16:54:07.020592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994 HTTP/1.1 Jul 01 16:54:07.020592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept: application/json Jul 01 16:54:07.020592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jul 01 16:54:07.020592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Connection: close Jul 01 16:54:07.020592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jul 01 16:54:07.020592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jul 01 16:54:07.020592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Host: 10.222.0.57 Jul 01 16:54:07.020592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jul 01 16:54:07.020592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jul 01 16:54:07.020592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivyZ1DrjdNpS6InX97jkmF5JfLrhaOmHAeCQ8s7CPOMmavEAtJMKFJqI4nRBWN7IG6_pBlysPuvzdqc7iotOjlt1PH0ZahiqMShfdLJwRVtQ4x29ijk5XeqYVU8HlRW4Vqy6X5NOS0RZD_phYcbktCRmxPvAGI4CD50vQu_f99wo33rg Jul 01 16:54:07.020592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jul 01 16:54:07.020592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jul 01 16:54:07.020592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jul 01 16:54:07.020592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jul 01 16:54:07.020592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jul 01 16:54:07.020592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jul 01 16:54:07.020592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Id: 0879ab147a0b4fbeb3ec90fdfdb53f24 Jul 01 16:54:07.020592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2030875900 Jul 01 16:54:07.020592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jul 01 16:54:07.020592 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jul 01 16:54:07.022325 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0879ab147a0b4fbeb3ec90fdfdb53f24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0879ab147a0b4fbeb3ec90fdfdb53f24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0879ab147a0b4fbeb3ec90fdfdb53f24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0879ab147a0b4fbeb3ec90fdfdb53f24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:54:07.022325 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-VolumesSnapshotTestJSON-2030875900 Jul 01 16:54:07.022325 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 0879ab147a0b4fbeb3ec90fdfdb53f24 Jul 01 16:54:07.022325 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2030875900 Jul 01 16:54:07.022325 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User: tempest-VolumesSnapshotTestJSON-2030875900-project Jul 01 16:54:07.022325 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jul 01 16:54:07.022325 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jul 01 16:54:07.022325 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Id: 520e0eae82a64ed98a6c0cfbd19cdbb4 Jul 01 16:54:07.022325 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-VolumesSnapshotTestJSON-2030875900-project Jul 01 16:54:07.022325 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: method: > Jul 01 16:54:07.022325 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: exception: Instance e3e5fc84-bcc4-4f95-9ef2-749766d42994 could not be found. Jul 01 16:54:07.022325 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: action_args: {'id': 'e3e5fc84-bcc4-4f95-9ef2-749766d42994'} Jul 01 16:54:07.023520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:54:07.023520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:54:07.023520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:54:07.023520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:54:07.023520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:54:07.023520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:54:07.023520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:54:07.023520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:54:07.023520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:54:07.023520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:54:07.023520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3e5fc84-bcc4-4f95-9ef2-749766d42994 could not be found. Jul 01 16:54:07.023520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:54:07.023520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:54:07.023520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:54:07.023520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:54:07.023520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:54:07.023520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:54:07.023520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:54:07.023520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:54:07.023520 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:54:07.025784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:54:07.025784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:54:07.025784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:54:07.025784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:54:07.025784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:54:07.025784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:54:07.025784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:54:07.025784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3e5fc84-bcc4-4f95-9ef2-749766d42994 could not be found. Jul 01 16:54:07.025784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:54:07.025784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:54:07.025784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:54:07.025784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:54:07.025784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:54:07.025784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:54:07.025784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:54:07.025784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:54:07.025784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3e5fc84-bcc4-4f95-9ef2-749766d42994 could not be found. Jul 01 16:54:07.025784 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jul 01 16:54:07.027363 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5d9ed9e6-7164-4dc8-b4a1-251c30e390a5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Returning 404 to user: Instance e3e5fc84-bcc4-4f95-9ef2-749766d42994 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:54:07.027363 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5d9ed9e6-7164-4dc8-b4a1-251c30e390a5 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994" status: 404 len: 111 microversion: 2.1 time: 0.030345 Jul 01 16:54:07.027363 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 525/1056] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:54:06 2022] GET /compute/v2.1/servers/e3e5fc84-bcc4-4f95-9ef2-749766d42994 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:54:14.796141 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0bc953bc-1c1b-4b0e-b855-776accfc4529 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2000430817", "imageRef": "42a4b1a9-dea6-4c87-a2c1-328b9c0c8558", "flavorRef": "452", "networks": [{"uuid": "08000a35-2dec-4993-b9a5-7cf20485ea74"}]}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:54:14.847762 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.network.neutron [None req-0bc953bc-1c1b-4b0e-b855-776accfc4529 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] validate_networks() for [('08000a35-2dec-4993-b9a5-7cf20485ea74', None, None, None, None, None)] {{(pid=124317) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 16:54:15.240627 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-0bc953bc-1c1b-4b0e-b855-776accfc4529 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Flavor limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 16:54:15.241098 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-0bc953bc-1c1b-4b0e-b855-776accfc4529 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Image limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 16:54:15.241566 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-0bc953bc-1c1b-4b0e-b855-776accfc4529 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Flavor pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 16:54:15.241970 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-0bc953bc-1c1b-4b0e-b855-776accfc4529 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Image pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 16:54:15.242402 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-0bc953bc-1c1b-4b0e-b855-776accfc4529 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 16:54:15.251996 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0bc953bc-1c1b-4b0e-b855-776accfc4529 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:15.252438 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0bc953bc-1c1b-4b0e-b855-776accfc4529 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:15.253219 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0bc953bc-1c1b-4b0e-b855-776accfc4529 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:15.253646 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0bc953bc-1c1b-4b0e-b855-776accfc4529 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:15.270398 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-0bc953bc-1c1b-4b0e-b855-776accfc4529 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Getting quotas for project 0879ab147a0b4fbeb3ec90fdfdb53f24. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 16:54:15.275319 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-0bc953bc-1c1b-4b0e-b855-776accfc4529 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Getting quotas for user 520e0eae82a64ed98a6c0cfbd19cdbb4 and project 0879ab147a0b4fbeb3ec90fdfdb53f24. Resources: {'ram', 'cores', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 16:54:15.286176 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0bc953bc-1c1b-4b0e-b855-776accfc4529 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Going to run 1 instances... {{(pid=124317) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 16:54:15.288442 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0bc953bc-1c1b-4b0e-b855-776accfc4529 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: 9ccbb11c-9a22-41df-a290-d251ec103d36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42a4b1a9-dea6-4c87-a2c1-328b9c0c8558',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124317) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 16:54:15.340260 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0bc953bc-1c1b-4b0e-b855-776accfc4529 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547935 Jul 01 16:54:15.340906 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 532/1057] 10.222.0.57 () {60 vars in 1146 bytes} [Fri Jul 1 16:54:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 16:54:15.350737 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b42db60c-0135-4ed0-a720-80f4822249ba tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:54:15.351345 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b42db60c-0135-4ed0-a720-80f4822249ba tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: 9ccbb11c-9a22-41df-a290-d251ec103d36] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:54:15.410252 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b42db60c-0135-4ed0-a720-80f4822249ba tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:54:15.417897 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b42db60c-0135-4ed0-a720-80f4822249ba tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36" status: 200 len: 1219 microversion: 2.1 time: 0.070878 Jul 01 16:54:15.418668 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 526/1058] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:54:15 2022] GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:54:16.435932 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b306b3a3-81e5-45fe-8637-d8dea0597570 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:54:16.436557 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b306b3a3-81e5-45fe-8637-d8dea0597570 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: 9ccbb11c-9a22-41df-a290-d251ec103d36] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:54:16.442995 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b306b3a3-81e5-45fe-8637-d8dea0597570 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:16.443442 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b306b3a3-81e5-45fe-8637-d8dea0597570 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:16.444206 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b306b3a3-81e5-45fe-8637-d8dea0597570 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:16.444696 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b306b3a3-81e5-45fe-8637-d8dea0597570 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:16.520768 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b306b3a3-81e5-45fe-8637-d8dea0597570 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:54:16.529321 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b306b3a3-81e5-45fe-8637-d8dea0597570 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36" status: 200 len: 1289 microversion: 2.1 time: 0.098015 Jul 01 16:54:16.529884 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 533/1059] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:54:16 2022] GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36 => generated 1289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:54:17.546925 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-16baf5d8-302e-4ba6-be1c-62700571728f tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:54:17.547845 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-16baf5d8-302e-4ba6-be1c-62700571728f tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: 9ccbb11c-9a22-41df-a290-d251ec103d36] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:54:17.551417 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:54:17.557249 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-16baf5d8-302e-4ba6-be1c-62700571728f tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:17.557699 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-16baf5d8-302e-4ba6-be1c-62700571728f tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:17.558525 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-16baf5d8-302e-4ba6-be1c-62700571728f tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:17.558971 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-16baf5d8-302e-4ba6-be1c-62700571728f tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:17.752517 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-16baf5d8-302e-4ba6-be1c-62700571728f tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:54:17.761326 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-16baf5d8-302e-4ba6-be1c-62700571728f tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36" status: 200 len: 1319 microversion: 2.1 time: 0.218290 Jul 01 16:54:17.761893 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 527/1060] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:54:17 2022] GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:54:17.812185 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-0e63a27d-6dfc-4b38-a059-ea21cc5af7b2 req-5f08deb6-2896-4228-97c6-c1eaa92e8114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ccbb11c-9a22-41df-a290-d251ec103d36", "tag": "fc9f1304-9324-40cd-95db-77b469a51d83"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:54:17.823013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-0e63a27d-6dfc-4b38-a059-ea21cc5af7b2 req-5f08deb6-2896-4228-97c6-c1eaa92e8114 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:17.823600 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-0e63a27d-6dfc-4b38-a059-ea21cc5af7b2 req-5f08deb6-2896-4228-97c6-c1eaa92e8114 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:17.842409 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-0e63a27d-6dfc-4b38-a059-ea21cc5af7b2 req-5f08deb6-2896-4228-97c6-c1eaa92e8114 service nova] Creating event network-changed:fc9f1304-9324-40cd-95db-77b469a51d83 for instance 9ccbb11c-9a22-41df-a290-d251ec103d36 on hv-cinder-79760 Jul 01 16:54:17.847428 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-0e63a27d-6dfc-4b38-a059-ea21cc5af7b2 req-5f08deb6-2896-4228-97c6-c1eaa92e8114 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039195 Jul 01 16:54:17.848038 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 534/1061] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:54:18.778749 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ffc7d6b4-dca8-40e9-a993-fe00b6b05b85 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:54:18.779367 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ffc7d6b4-dca8-40e9-a993-fe00b6b05b85 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: 9ccbb11c-9a22-41df-a290-d251ec103d36] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:54:18.785610 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ffc7d6b4-dca8-40e9-a993-fe00b6b05b85 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:18.786088 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ffc7d6b4-dca8-40e9-a993-fe00b6b05b85 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:18.786935 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ffc7d6b4-dca8-40e9-a993-fe00b6b05b85 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:18.787402 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ffc7d6b4-dca8-40e9-a993-fe00b6b05b85 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:18.921407 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ffc7d6b4-dca8-40e9-a993-fe00b6b05b85 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:54:18.928898 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ffc7d6b4-dca8-40e9-a993-fe00b6b05b85 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36" status: 200 len: 1319 microversion: 2.1 time: 0.154272 Jul 01 16:54:18.929465 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 528/1062] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:54:18 2022] GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:54:19.945637 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6e1722a1-4b4c-4d8f-8991-46548c10e7fc tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:54:19.947103 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6e1722a1-4b4c-4d8f-8991-46548c10e7fc tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: 9ccbb11c-9a22-41df-a290-d251ec103d36] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:54:19.953800 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6e1722a1-4b4c-4d8f-8991-46548c10e7fc tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:19.954248 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6e1722a1-4b4c-4d8f-8991-46548c10e7fc tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:19.955040 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6e1722a1-4b4c-4d8f-8991-46548c10e7fc tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:19.955479 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6e1722a1-4b4c-4d8f-8991-46548c10e7fc tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:20.092811 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6e1722a1-4b4c-4d8f-8991-46548c10e7fc tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:54:20.100358 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6e1722a1-4b4c-4d8f-8991-46548c10e7fc tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36" status: 200 len: 1319 microversion: 2.1 time: 0.158973 Jul 01 16:54:20.100922 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 535/1063] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:54:19 2022] GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:54:21.117246 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-06eadc3a-37b1-4d40-850d-88673dd74670 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:54:21.117908 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-06eadc3a-37b1-4d40-850d-88673dd74670 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: 9ccbb11c-9a22-41df-a290-d251ec103d36] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:54:21.124553 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-06eadc3a-37b1-4d40-850d-88673dd74670 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:21.125008 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-06eadc3a-37b1-4d40-850d-88673dd74670 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:21.125917 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-06eadc3a-37b1-4d40-850d-88673dd74670 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:21.126386 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-06eadc3a-37b1-4d40-850d-88673dd74670 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:21.262139 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-06eadc3a-37b1-4d40-850d-88673dd74670 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:54:21.269577 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-06eadc3a-37b1-4d40-850d-88673dd74670 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36" status: 200 len: 1319 microversion: 2.1 time: 0.156252 Jul 01 16:54:21.270145 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 529/1064] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:54:21 2022] GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:54:22.286374 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c6b990a6-dcfa-4d0f-ba18-aa6d4eff18ee tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:54:22.286989 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c6b990a6-dcfa-4d0f-ba18-aa6d4eff18ee tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: 9ccbb11c-9a22-41df-a290-d251ec103d36] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:54:22.293439 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c6b990a6-dcfa-4d0f-ba18-aa6d4eff18ee tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:22.293891 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c6b990a6-dcfa-4d0f-ba18-aa6d4eff18ee tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:22.294680 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c6b990a6-dcfa-4d0f-ba18-aa6d4eff18ee tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:22.295123 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c6b990a6-dcfa-4d0f-ba18-aa6d4eff18ee tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:22.375181 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-1b7763e5-ae28-4316-9bef-7207fe30145e req-b637a181-e15e-4281-b88e-de77469b9062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ccbb11c-9a22-41df-a290-d251ec103d36", "name": "network-vif-plugged", "status": "completed", "tag": "fc9f1304-9324-40cd-95db-77b469a51d83"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:54:22.384861 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-1b7763e5-ae28-4316-9bef-7207fe30145e req-b637a181-e15e-4281-b88e-de77469b9062 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:22.385712 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-1b7763e5-ae28-4316-9bef-7207fe30145e req-b637a181-e15e-4281-b88e-de77469b9062 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:22.399099 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-1b7763e5-ae28-4316-9bef-7207fe30145e req-b637a181-e15e-4281-b88e-de77469b9062 service nova] Creating event network-vif-plugged:fc9f1304-9324-40cd-95db-77b469a51d83 for instance 9ccbb11c-9a22-41df-a290-d251ec103d36 on hv-cinder-79760 Jul 01 16:54:22.404781 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-1b7763e5-ae28-4316-9bef-7207fe30145e req-b637a181-e15e-4281-b88e-de77469b9062 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033697 Jul 01 16:54:22.405423 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 530/1065] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:54:22.432649 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c6b990a6-dcfa-4d0f-ba18-aa6d4eff18ee tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:54:22.440726 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c6b990a6-dcfa-4d0f-ba18-aa6d4eff18ee tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36" status: 200 len: 1319 microversion: 2.1 time: 0.158241 Jul 01 16:54:22.441298 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 536/1066] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:54:22 2022] GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:54:23.463391 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-104d907e-4645-4dec-8625-74e0f7d7e305 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:54:23.464006 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-104d907e-4645-4dec-8625-74e0f7d7e305 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: 9ccbb11c-9a22-41df-a290-d251ec103d36] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:54:23.470306 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-104d907e-4645-4dec-8625-74e0f7d7e305 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:23.470799 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-104d907e-4645-4dec-8625-74e0f7d7e305 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:23.471582 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-104d907e-4645-4dec-8625-74e0f7d7e305 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:23.472025 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-104d907e-4645-4dec-8625-74e0f7d7e305 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:23.606067 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-104d907e-4645-4dec-8625-74e0f7d7e305 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:54:23.613730 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-104d907e-4645-4dec-8625-74e0f7d7e305 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36" status: 200 len: 1319 microversion: 2.1 time: 0.156309 Jul 01 16:54:23.614408 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 531/1067] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:54:23 2022] GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:54:24.631632 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b42689be-c118-4e87-9a75-105d19ba0e4e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:54:24.632267 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b42689be-c118-4e87-9a75-105d19ba0e4e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: 9ccbb11c-9a22-41df-a290-d251ec103d36] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:54:24.639243 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b42689be-c118-4e87-9a75-105d19ba0e4e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:24.639689 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b42689be-c118-4e87-9a75-105d19ba0e4e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:24.640441 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b42689be-c118-4e87-9a75-105d19ba0e4e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:24.640873 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b42689be-c118-4e87-9a75-105d19ba0e4e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:24.778324 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b42689be-c118-4e87-9a75-105d19ba0e4e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:54:24.788147 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b42689be-c118-4e87-9a75-105d19ba0e4e tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36" status: 200 len: 1509 microversion: 2.1 time: 0.160384 Jul 01 16:54:24.788775 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 537/1068] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:54:24 2022] GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:54:24.808373 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-dcb603ea-205f-4607-9e94-fb2558c2648a tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea8456e3-35e3-4e52-a7c8-aa843bc095ec", "device": "/dev/sdb"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:54:24.810777 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-dcb603ea-205f-4607-9e94-fb2558c2648a tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: 9ccbb11c-9a22-41df-a290-d251ec103d36] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:54:24.819097 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dcb603ea-205f-4607-9e94-fb2558c2648a tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:24.819554 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dcb603ea-205f-4607-9e94-fb2558c2648a tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:24.820330 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dcb603ea-205f-4607-9e94-fb2558c2648a tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:24.820766 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dcb603ea-205f-4607-9e94-fb2558c2648a tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:25.069320 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-dcb603ea-205f-4607-9e94-fb2558c2648a tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "POST /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265765 Jul 01 16:54:25.069921 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 532/1069] 10.222.0.57 () {60 vars in 1322 bytes} [Fri Jul 1 16:54:24 2022] POST /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 16:54:44.377306 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-64d71af1-6b43-4192-b80b-6c2ad2a8f1e7 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:54:44.377804 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-64d71af1-6b43-4192-b80b-6c2ad2a8f1e7 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: 9ccbb11c-9a22-41df-a290-d251ec103d36] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:54:44.379847 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:54:44.380507 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=6 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:54:44.381238 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:54:44.381853 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:54:44.389403 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-64d71af1-6b43-4192-b80b-6c2ad2a8f1e7 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:44.389859 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-64d71af1-6b43-4192-b80b-6c2ad2a8f1e7 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:44.390660 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-64d71af1-6b43-4192-b80b-6c2ad2a8f1e7 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:44.391098 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-64d71af1-6b43-4192-b80b-6c2ad2a8f1e7 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:44.474788 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-64d71af1-6b43-4192-b80b-6c2ad2a8f1e7 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lazy-loading 'services' on Instance uuid 9ccbb11c-9a22-41df-a290-d251ec103d36 {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 16:54:44.553069 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-64d71af1-6b43-4192-b80b-6c2ad2a8f1e7 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36/os-volume_attachments/ea8456e3-35e3-4e52-a7c8-aa843bc095ec" status: 202 len: 0 microversion: 2.1 time: 0.179641 Jul 01 16:54:44.553829 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 538/1070] 10.222.0.57 () {58 vars in 1415 bytes} [Fri Jul 1 16:54:44 2022] DELETE /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36/os-volume_attachments/ea8456e3-35e3-4e52-a7c8-aa843bc095ec => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 16:54:45.665352 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:54:45.666466 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=24 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:54:45.667449 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:54:45.672745 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-88dd20ab-0733-49bd-a2d7-4add08829ed8 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:54:45.673370 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-88dd20ab-0733-49bd-a2d7-4add08829ed8 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: 9ccbb11c-9a22-41df-a290-d251ec103d36] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:54:45.682434 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-88dd20ab-0733-49bd-a2d7-4add08829ed8 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:45.682882 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-88dd20ab-0733-49bd-a2d7-4add08829ed8 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:45.683665 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-88dd20ab-0733-49bd-a2d7-4add08829ed8 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:45.684098 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-88dd20ab-0733-49bd-a2d7-4add08829ed8 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:45.710288 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-88dd20ab-0733-49bd-a2d7-4add08829ed8 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: 9ccbb11c-9a22-41df-a290-d251ec103d36] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 16:54:45.786364 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-88dd20ab-0733-49bd-a2d7-4add08829ed8 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36" status: 204 len: 0 microversion: 2.1 time: 0.122165 Jul 01 16:54:45.786983 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 533/1071] 10.222.0.57 () {58 vars in 1238 bytes} [Fri Jul 1 16:54:45 2022] DELETE /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 16:54:45.796700 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1127e667-7071-4087-a839-e3e81d93581b tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:54:45.797398 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1127e667-7071-4087-a839-e3e81d93581b tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: 9ccbb11c-9a22-41df-a290-d251ec103d36] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:54:45.804134 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1127e667-7071-4087-a839-e3e81d93581b tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:45.804576 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1127e667-7071-4087-a839-e3e81d93581b tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:45.805321 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1127e667-7071-4087-a839-e3e81d93581b tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:45.806408 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1127e667-7071-4087-a839-e3e81d93581b tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:45.938522 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1127e667-7071-4087-a839-e3e81d93581b tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:54:45.946201 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1127e667-7071-4087-a839-e3e81d93581b tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36" status: 200 len: 1515 microversion: 2.1 time: 0.153941 Jul 01 16:54:45.947001 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 539/1072] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:54:45 2022] GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:54:46.965383 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-47d78c9d-07d2-42de-afcd-3397225c4672 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:54:46.966077 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-47d78c9d-07d2-42de-afcd-3397225c4672 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: 9ccbb11c-9a22-41df-a290-d251ec103d36] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:54:46.972539 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-47d78c9d-07d2-42de-afcd-3397225c4672 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:46.972984 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-47d78c9d-07d2-42de-afcd-3397225c4672 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:46.973738 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-47d78c9d-07d2-42de-afcd-3397225c4672 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:46.974175 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-47d78c9d-07d2-42de-afcd-3397225c4672 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:47.105013 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-47d78c9d-07d2-42de-afcd-3397225c4672 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:54:47.112509 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-47d78c9d-07d2-42de-afcd-3397225c4672 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36" status: 200 len: 1515 microversion: 2.1 time: 0.152166 Jul 01 16:54:47.113070 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 534/1073] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:54:46 2022] GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:54:48.117506 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-97064526-94be-4c2b-b5f9-9723ab893dc3 req-5ca4b5c8-c980-4f7f-8089-278bf6c17433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ccbb11c-9a22-41df-a290-d251ec103d36", "name": "network-vif-deleted", "tag": "fc9f1304-9324-40cd-95db-77b469a51d83"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 16:54:48.128545 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-97064526-94be-4c2b-b5f9-9723ab893dc3 req-5ca4b5c8-c980-4f7f-8089-278bf6c17433 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:48.129078 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-97064526-94be-4c2b-b5f9-9723ab893dc3 req-5ca4b5c8-c980-4f7f-8089-278bf6c17433 service nova] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:48.129217 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-15b783bb-b74c-4838-8b60-9fc794a8e862 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:54:48.129885 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-15b783bb-b74c-4838-8b60-9fc794a8e862 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: 9ccbb11c-9a22-41df-a290-d251ec103d36] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:54:48.137517 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-15b783bb-b74c-4838-8b60-9fc794a8e862 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:48.138049 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-15b783bb-b74c-4838-8b60-9fc794a8e862 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:48.138860 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-15b783bb-b74c-4838-8b60-9fc794a8e862 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:48.139306 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-15b783bb-b74c-4838-8b60-9fc794a8e862 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:48.142821 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-97064526-94be-4c2b-b5f9-9723ab893dc3 req-5ca4b5c8-c980-4f7f-8089-278bf6c17433 service nova] Creating event network-vif-deleted:fc9f1304-9324-40cd-95db-77b469a51d83 for instance 9ccbb11c-9a22-41df-a290-d251ec103d36 on hv-cinder-79760 Jul 01 16:54:48.147837 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-97064526-94be-4c2b-b5f9-9723ab893dc3 req-5ca4b5c8-c980-4f7f-8089-278bf6c17433 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034086 Jul 01 16:54:48.148699 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 540/1074] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Jul 1 16:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 16:54:48.207358 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-15b783bb-b74c-4838-8b60-9fc794a8e862 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520e0eae82a64ed98a6c0cfbd19cdbb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0879ab147a0b4fbeb3ec90fdfdb53f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 16:54:48.216974 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-15b783bb-b74c-4838-8b60-9fc794a8e862 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36" status: 200 len: 1473 microversion: 2.1 time: 0.091665 Jul 01 16:54:48.217567 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 535/1075] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:54:48 2022] GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36 => generated 1473 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 16:54:49.235760 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-495a59cd-aed0-4e16-aac0-bfd79e106714 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 16:54:49.236378 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-495a59cd-aed0-4e16-aac0-bfd79e106714 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] [instance: 9ccbb11c-9a22-41df-a290-d251ec103d36] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 16:54:49.242619 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-495a59cd-aed0-4e16-aac0-bfd79e106714 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:49.243077 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-495a59cd-aed0-4e16-aac0-bfd79e106714 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:49.244349 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-495a59cd-aed0-4e16-aac0-bfd79e106714 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 16:54:49.244787 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-495a59cd-aed0-4e16-aac0-bfd79e106714 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Lock "2d4cbc3c-94ee-4f68-9082-34d85fef2b77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 16:54:49.257821 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-495a59cd-aed0-4e16-aac0-bfd79e106714 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] HTTP exception thrown: Instance 9ccbb11c-9a22-41df-a290-d251ec103d36 could not be found. Jul 01 16:54:49.260558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-495a59cd-aed0-4e16-aac0-bfd79e106714 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Request method failure captured: Jul 01 16:54:49.260558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36 HTTP/1.1 Jul 01 16:54:49.260558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept: application/json Jul 01 16:54:49.260558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jul 01 16:54:49.260558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Connection: close Jul 01 16:54:49.260558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jul 01 16:54:49.260558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jul 01 16:54:49.260558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Host: 10.222.0.57 Jul 01 16:54:49.260558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jul 01 16:54:49.260558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jul 01 16:54:49.260558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivyZ1DrjdNpS6InX97jkmF5JfLrhaOmHAeCQ8s7CPOMmavEAtJMKFJqI4nRBWN7IG6_pBlysPuvzdqc7iotOjlt1PH0ZahiqMShfdLJwRVtQ4x29ijk5XeqYVU8HlRW4Vqy6X5NOS0RZD_phYcbktCRmxPvAGI4CD50vQu_f99wo33rg Jul 01 16:54:49.260558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jul 01 16:54:49.260558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jul 01 16:54:49.260558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jul 01 16:54:49.260558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jul 01 16:54:49.260558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jul 01 16:54:49.260558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jul 01 16:54:49.260558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Id: 0879ab147a0b4fbeb3ec90fdfdb53f24 Jul 01 16:54:49.260558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2030875900 Jul 01 16:54:49.260558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jul 01 16:54:49.260558 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jul 01 16:54:49.262306 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0879ab147a0b4fbeb3ec90fdfdb53f24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0879ab147a0b4fbeb3ec90fdfdb53f24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0879ab147a0b4fbeb3ec90fdfdb53f24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0879ab147a0b4fbeb3ec90fdfdb53f24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Jul 01 16:54:49.262306 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-VolumesSnapshotTestJSON-2030875900 Jul 01 16:54:49.262306 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 0879ab147a0b4fbeb3ec90fdfdb53f24 Jul 01 16:54:49.262306 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2030875900 Jul 01 16:54:49.262306 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User: tempest-VolumesSnapshotTestJSON-2030875900-project Jul 01 16:54:49.262306 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jul 01 16:54:49.262306 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jul 01 16:54:49.262306 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Id: 520e0eae82a64ed98a6c0cfbd19cdbb4 Jul 01 16:54:49.262306 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-VolumesSnapshotTestJSON-2030875900-project Jul 01 16:54:49.262306 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: method: > Jul 01 16:54:49.262306 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: exception: Instance 9ccbb11c-9a22-41df-a290-d251ec103d36 could not be found. Jul 01 16:54:49.262306 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: action_args: {'id': '9ccbb11c-9a22-41df-a290-d251ec103d36'} Jul 01 16:54:49.263309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 16:54:49.263309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:54:49.263309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 16:54:49.263309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 16:54:49.263309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 16:54:49.263309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 16:54:49.263309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 16:54:49.263309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 16:54:49.263309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 16:54:49.263309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 16:54:49.263309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ccbb11c-9a22-41df-a290-d251ec103d36 could not be found. Jul 01 16:54:49.263309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:54:49.263309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:54:49.263309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:54:49.263309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:54:49.263309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:54:49.263309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:54:49.263309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 16:54:49.263309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 16:54:49.263309 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 16:54:49.265013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 16:54:49.265013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 16:54:49.265013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 16:54:49.265013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 16:54:49.265013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 16:54:49.265013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 16:54:49.265013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 16:54:49.265013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ccbb11c-9a22-41df-a290-d251ec103d36 could not be found. Jul 01 16:54:49.265013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:54:49.265013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 16:54:49.265013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:54:49.265013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 16:54:49.265013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 16:54:49.265013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 16:54:49.265013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 16:54:49.265013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 16:54:49.265013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ccbb11c-9a22-41df-a290-d251ec103d36 could not be found. Jul 01 16:54:49.265013 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jul 01 16:54:49.266482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-495a59cd-aed0-4e16-aac0-bfd79e106714 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] Returning 404 to user: Instance 9ccbb11c-9a22-41df-a290-d251ec103d36 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 16:54:49.266482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-495a59cd-aed0-4e16-aac0-bfd79e106714 tempest-VolumesSnapshotTestJSON-2030875900 tempest-VolumesSnapshotTestJSON-2030875900-project] 10.222.0.57 "GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36" status: 404 len: 111 microversion: 2.1 time: 0.030946 Jul 01 16:54:49.266482 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 541/1076] 10.222.0.57 () {58 vars in 1235 bytes} [Fri Jul 1 16:54:49 2022] GET /compute/v2.1/servers/9ccbb11c-9a22-41df-a290-d251ec103d36 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 16:55:14.495246 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 16:55:14.496003 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Fri Jul 1 16:55:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 16:55:48.226839 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 16:55:48.227429 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Fri Jul 1 16:55:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 16:57:02.951695 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 16:57:02.952447 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Fri Jul 1 16:57:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 16:57:14.221644 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 16:57:14.222222 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Fri Jul 1 16:57:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 16:57:31.382500 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 16:57:31.383201 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Fri Jul 1 16:57:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 16:57:35.940160 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 16:57:35.940691 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Fri Jul 1 16:57:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 16:58:34.506186 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 16:58:34.506972 dv-cinder-797608-41-iscsi devstack@n-api.service[124317]: Fri Jul 1 16:58:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 16:59:08.234448 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 16:59:08.235048 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Fri Jul 1 16:59:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 17:00:22.960046 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 17:00:22.960767 dv-cinder-797608-41-iscsi devstack@n-api.service[124316]: Fri Jul 1 17:00:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!